We developed a compact, wearable diagnostic imaging modality employing optical coherence tomography for in situ plant leaf quality assessments. This system is capable of diagnosing infected leaves at the initial disease stages. Our system is a versatile backpack-type imaging modality with a compact spectrometer, miniature computer, rechargeable power source, and handheld inspection probe. This method enhances real-time in situ specimen inspection through direct implementation of the imaging modality in a plantation. To evaluate the initial performance, field experiments were conducted in apple, pear, and persimmon plantations. Based on the obtained results, we can conclude that the developed imaging modality can be considered as a promising, efficient, convenient, and fast in situ inspection technique for various agricultural fields, which minimizes the limitations of complex tabletop inspection modalities.