The synthesis of a modular colloidal polymer system based on the dipolar assembly of CdSe@CdS nanorods functionalized with a single cobalt nanoparticle "tip" (CoNP-tip) is reported. These heterostructured nanorods spontaneously self-assembled via magnetic dipolar associations of the cobalt domains. In these assemblies, CdSe@CdS nanorods were carried as densely grafted side chain groups along the dipolar NP chain to form bottlebrush-type colloidal polymers. Nanorod side chains strongly affected the conformation of individual colloidal polymer bottlebrush chains and the morphology of thin films. Dipolar CoNP-tipped nanorods were then used as "colloidal monomers" to form mesoscopic assemblies reminiscent of traditional copolymers possessing segmented and statistical compositions. Investigation of the phase behavior of colloidal polymer blends revealed the formation of mesoscopic phase separated morphologies from segmented colloidal copolymers. These studies demonstrated the ability to control colloidal polymer composition and morphology in a manner observed for classical polymer systems by synthetic control of heterostructured nanorod structure and harnessing interparticle dipolar associations.