Cells are heterogeneous on every length and time scale; cytosol contains thousands of proteins, lipids, nucleic acids, and small molecules, and molecular interactions within this crowded environment determine the structure, dynamics, and stability of biomolecules. For decades, the effects of crowding at the atomistic scale have been overlooked in favor of more tractable models largely based on thermodynamics. Crowding can affect the conformations and stability of biomolecules by modulating water structure and dynamics within the cell, and these effects are nonlocal and environment dependent. Thus, characterizing water's hydrogen-bond (H-bond) networks is a critical step toward a complete microscopic crowding model. This perspective provides an overview of molecular crowding and describes recent time-resolved spectroscopy approaches investigating H-bond networks and dynamics in crowded or otherwise complex aqueous environments. Ultrafast spectroscopy combined with atomistic simulations has emerged as a powerful combination for studying H-bond structure and dynamics in heterogeneous multicomponent systems. We discuss the ongoing challenges toward developing a complete atomistic description of macromolecular crowding from an experimental as well as a theoretical perspective.