Advances in mobile electroencephalography (EEG) technology have made it possible to examine covert cognitive processes in real-world settings such as student attention in the classroom. Here, we outline research using wired and wireless EEG technology to examine attention in elementary school children across increasingly naturalistic paradigms in schools, ranging from a lab-based paradigm where children met one-on-one with an experimenter in a field laboratory to mobile EEG testing conducted in the same school during semi-naturalistic classroom lessons. Despite an increase of data loss with the classroom-based paradigm, we demonstrate that it is feasible to collect quality data in classroom settings with young children. We also provide a test case for how robust EEG signals, such as alpha oscillations, can be used to identify measurable differences in covert processes like attention in classrooms. We end with pragmatic suggestions for researchers interested in employing naturalistic EEG methods in real-world, multisensory contexts.