As x-ray microscopy is pushed into the nanoscale with the advent of more bright and coherent x-ray sources, associated improvement in spatial resolution becomes highly vulnerable to geometrical errors and uncertainties during data collection. We address a form of error in tomography experiments, namely, the drift between projections during the tomographic scan. Our proposed method can simultaneously recover the drift, while tomographically reconstructing the specimen based on a joint iterative optimization scheme. This approach utilizes the correlation provided from different view angles and different signals. While generally applicable, we demonstrate our method on x-ray fluorescence tomography from a tissue specimen and compare the reconstruction quality with conventional methods.