Swabs taken from the surface of a suspicious object are a standard method of identifying a concealed explosive device in security-conscious locations like airports. In this paper we demonstrate a sensitive method to collect and detect trace explosive residues from improvised explosive devices using swabs and an optical sensor element. Swabs coated with a commercial fluoropolymer are used to collect material and are subsequently heated to thermally desorb the explosives, causing the quenching of light emission from a thin film luminescent sensor. We report the sorption and desorption characteristics of swabs loaded with 2,4-DNT tested with Super Yellow fluorescent sensors in a laboratory setting, with detection that is up to three orders of magnitude more sensitive than standard colorimetric tests. The method was then applied in field tests with raw military-grade explosives TNT, PETN and RDX, on various objects containing the explosives, and post-blast craters. We show for the first time results using organic semiconductors to detect sub-milligram amounts of explosive sorbed onto a substrate from real explosives in the field, giving a promising new approach for IED detection.