This study demonstrates the possibility of controlling the directed self-assembly of microsized Janus cylinders by changing the solvent polarity of the assembly media. Experimental results are analyzed and theoretical calculations of the free energy of adhesion (ΔGad) are performed to elucidate the underlying basic principles and investigate the effects of the solvent on the self-assembled structures. This approach will pave a predictive route for controlling the structures of assembly depending on the solvent polarity. In particular, we find that a binary solvent system with precisely controlled polarity induces directional assembly of the microsized Janus cylinders. Thus, the formation of two-dimensional (2D) and three-dimensional (3D) assembled clusters can be reliably tuned by controlling the numbers of constituent Janus cylinders in a binary solvent system. Finally, this approach is expanded to stepwise assembly, which forms unique microstructures via secondary growth of primary seed clusters formed by the Janus cylinders. We envision that this investigation is highly promising for the construction of desired superstructures using a wide variety of polymeric Janus microparticles with chemical and physical multicompartments.