A motile bacterium swims by generating flow in its surrounding liquid. Anisotropy of the suspending liquid significantly modifies the swimming dynamics and corresponding flow signatures of an individual bacterium and impacts collective behavior. We study the interactions between swimming bacteria in an anisotropic environment exemplified by lyotropic chromonic liquid crystal. Our analysis reveals a significant localization of the bacteria-induced flow along a line coaxial with the bacterial body, which is due to strong viscosity anisotropy of the liquid crystal. Despite the fact that the average viscosity of the liquid crystal is two to three orders of magnitude higher than the viscosity of pure water, the speed of bacteria in the liquid crystal is of the same order of magnitude as in water. We show that bacteria can transport a cargo (a fluorescent particle) along a predetermined trajectory defined by the direction of molecular orientation of the liquid crystal. We demonstrate that while the hydrodynamic interaction between flagella of two close-by bacteria is negligible, the observed convergence of the swimming speeds as well as flagella waves' phase velocities may occur due to viscoelastic interaction between the bacterial bodies.