We describe the controlled transport and delivery of non-motile eukaryotic cells and polymer microparticles by swimming bacteria suspended in nematic liquid crystals. The bacteria push reversibly attached cargo in a stable, unidirectional path (or along a complex patterned director field) over exceptionally long distances. Numerical simulations and analytical predictions for swimming speeds provide a mechanistic insight into the hydrodynamics of the system. This study lays the foundation for using cargo-carrying bacteria in engineering applications and for understanding interspecies interactions in polymicrobial communities.