Diamonds have been shown to be an excellent platform for quantum computing and quantum sensing applications. These applications are enabled by the presence of defects in the lattice, which are also known as color centers. The most common nitrogen-based defect in synthetic diamonds is the paramagnetic nitrogen substitution (P1) center. While the majority of quantum applications rely on nitrogen-vacancy (NV) centers, the properties of the latter are heavily influenced by the presence and the spatial distribution of the P1 centers. Hence, understanding the spatial distribution and mutual interactions of P1 centers is crucial for the successful development of diamond-based quantum devices. Unlike NV centers, P1 centers do not have a spin-dependent optical signature, and their spin-related properties, therefore, have to be detected and characterized using magnetic resonance methods. We show that using high-field (6.9 and 13.8 T) pulsed electron paramagnetic resonance (EPR) and dynamic nuclear polarization (DNP) experiments, we can distinguish and quantify three distinct populations of P1 centers: isolated P1 centers, weakly interacting ones, and exchange-coupled ones that are clustered together. While such clustering was suggested before, these clusters were never detected directly and unambiguously. Moreover, by using electron-electron double resonance (ELDOR) pump-probe experiments, we demonstrate that the latter clustered population does not exist in isolation but coexists with the more weakly interacting P1 centers throughout the diamond lattice. Its presence thus strongly affects the quantum properties of the diamond. We also show that the existence of this population can explain recent hyperpolarization results in type Ib high-pressure, high-temperature (HPHT) diamonds. We propose a combination of high-field pulsed EPR, ELDOR, and DNP as a tool for probing the aggregation state and interactions among different populations of nitrogen substitution centers.