We propose a new way to generate an observable geometric phase by means of a completely incoherent phenomenon. We show how to imprint a geometric phase to a system by adiabatically manipulating the environment with which it interacts. As a specific scheme, we analyze a multilevel atom interacting with a broadband squeezed vacuum bosonic bath. As the squeezing parameters are smoothly changed in time along a closed loop, the ground state of the system acquires a geometric phase. We also propose a scheme to measure such a geometric phase by means of a suitable polarization detection.