Focal modulation microscopy is an emerging fluorescence microscopy technique for in vivo imaging of thick biological tissues. Here, we present a theoretical study to assess its performance. The scalar diffraction theory is combined with Monte Carlo simulation to evaluate the signal-to-background ratio at various depths. The performance of confocal microscopy with a similar optical setup is also evaluated for comparison.