For successful soil remediation and hydrocarbon exploration operations, determining the total petroleum hydrocarbon (TPH) content of soils is an indispensable process step. This paper reports on the performance of a handheld Fourier transform near-infrared (FT-NIR) spectrometer for rapid and quantitative determination of TPH content of soils from two different sites by diffuse reflection measurements. For rapid decisions for exploration work or environmental site assessment projects, a quick─preferably on-site─determination of TPH content is valuable. Diffuse reflection NIR spectra were recorded from soil samples of two different sites with TPH reference values ranging from 350 to 30,000 ppm, as determined by capillary gas chromatography and flame ionization detection with hydrocarbon fingerprinting C1-C44. However, this paper not only addresses the development of site-specific partial-least squares (PLS) calibrations but also demonstrates the locally-weighted PLS (LW-PLS) technique, which can be used to develop global, site-independent PLS calibrations without significant penalty in calibration performance. As a first step, the diffuse reflection spectra were used to develop conservative, site-specific PLS calibration models with root-mean-square calibration/cross-validation errors (RMSEC/RMSECV) of 1043/1106 and 741/785 ppm TPH, respectively, and the average absolute prediction errors for samples not contained in the calibration set were 451 and 293 ppm for the two sites, respectively. In a further step, significant degradation of the RMSE values of a conservative PLS model based on the NIR spectra of both sites was then compared to the application of the LW-PLS method, with only a slight loss of the prediction accuracy relative to the site-independent models. This study confirms the ability of next-generation portable FT-NIR spectrometers to predict low TPH levels in various soil types through both─soil-specific and site-independent─calibrations, giving these spectrometers the potential to become rapid screening tools in the field.