We demonstrate that a single photon with an optimal temporal waveform can be efficiently loaded into a cavity. Using heralded narrow-band single photons with exponential growth wave packet shaped by an electro-optical amplitude modulator, whose time constant matches the photon lifetime in the cavity, we demonstrate a loading efficiency of (87±2)% from free space to a single-sided Fabry-Perot cavity. We further demonstrate directly loading heralded single Stokes photons into the cavity with an efficiency of (60±5)% without the electro-optical amplitude modulator and verify the time reversal between the frequency-entangled paired photons. Our result and approach may enable promising applications in realizing large-scale quantum networks based on cavity quantum electrodynamics.