Attosecond metrology sensitive to sub-optical-cycle electronic and structural dynamics is opening up new avenues for ultrafast spectroscopy of condensed matter. Using intense lightwaves to precisely control the fast carrier dynamics in crystals holds great promise for next-generation petahertz electronics and devices. The carrier dynamics can produce high-order harmonics of the driving field extending up into the extreme-ultraviolet region. Here, we introduce polarization-state-resolved high-harmonic spectroscopy of solids, which provides deeper insights into both electronic and structural sub-cycle dynamics. Performing high-harmonic generation measurements from silicon and quartz, we demonstrate that the polarization states of the harmonics are not only determined by crystal symmetries, but can be dynamically controlled, as a consequence of the intertwined interband and intraband electronic dynamics. We exploit this symmetry-dynamics duality to efficiently generate coherent circularly polarized harmonics from elliptically polarized pulses. Our experimental results are supported by ab-initio simulations, providing evidence for the microscopic origin of the phenomenon.