Surface-enhanced Raman scattering (SERS) is a very important tool in vibrational spectroscopy. The coupling of nanomaterials induces local surface plasmon resonance (LSPR), which contributes greatly to SERS. Due to its remarkable sensitivity in trace detection, SERS has gained prominence in the fields of catalysis, biosensors, drug tracking, and optoelectronic devices. SERS activity is believed to be closely related to the LSPR and charge transfer (CT) of the material. Noble metal nanostructures have been commonly used as SERS-active substrates due to their strong local electric fields and relatively mature preparation, application, and enhancement mechanisms. In recent years, SERS research based on semiconductor materials has attracted significant attention because semiconductor materials have advantages such as repeatable preparation, simple pretreatment, stable SERS spectra and superior biocompatibility, stability, and reproducibility. Semiconductor-based SERS has the potential to enrich SERS theory and applications. Thus, the development of semiconductor materials will introduce a new epoch for SERS-based research. In this review, we outline the two main kinds of semiconductor SERS-active substrates: inorganic and organic semiconductor SERS-active substrates. We also provide an overview of the SERS mechanism for different kinds of materials and SERS-based applications.