Solid-state nanopores with feature sizes around 5 nm play a critical role in bio-sensing fields, especially in single molecule detection and sequencing of DNA, RNA and proteins. In this paper we present a systematic study on shrinkage and site-selective modification of single-crystal silicon nanopores with a conventional scanning electron microscope (SEM). Square nanopores with measurable sizes as small as 8 nm × 8 nm and rectangle nanopores with feature sizes (the smaller one between length and width) down to 5 nm have been obtained, using the SEM-induced shrinkage technique. The analysis of energy dispersive x-ray spectroscopy and the recovery of the pore size and morphology reveal that the grown material along with the edge of the nanopore is the result of deposition of hydrocarbon compounds, without structural damage during the shrinking process. A simplified model for pore shrinkage has been developed based on observation of the cross-sectional morphology of the shrunk nanopore. The main factors impacting on the task of controllably shrinking the nanopores, such as the accelerating voltage, spot size, scanned area of e-beam, and the initial pore size have been discussed. It is found that single-crystal silicon nanopores shrink linearly with time under localized irradiation by SEM e-beam in all cases, and the pore shrinkage rate is inversely proportional to the initial equivalent diameter of the pore under the same e-beam conditions.