The cross-correlation of a diffuse wave field converges toward the difference between the anticausal and causal Green's functions between two points. This property has paved the way to passive imaging using ambient noise sources. In this Letter, we investigate Green's function retrieval in electromagnetism. Using a model based on the fluctuation dissipation theorem, we demonstrate theoretically that the cross-correlation function strongly depends on the absorption properties of the receivers. This is confirmed in measurements within a reverberation chamber. In contrast to measurements with noninvasive probes, we show that only the anticausal Green's function can be retrieved with a matched antenna. Finally, we interpret this result as an equivalent time-reversal experiment with an electromagnetic sink.