Given the finding that retrieval practice improves memory, it is frequently suggested that students test themselves while studying. This study examined whether participants benefit from testing if they create and use their own test questions. In Experiment 1, participants read passages, generated questions about the passages, and then either answered their questions as they created them (the procedure used in previous studies) or after a delay. In Experiments 2 and 3, participants either generated questions and answered them after a delay (i.e., self-testing), answered experimenter-provided questions, or reread the passages before taking a final test administered shortly after learning or following a 2-day delay. The experiments found no benefits of answering one's own questions after a delay. In fact, those who self-tested tended to have worse performance on a final assessment of learning than the other learning conditions. Exploratory analyses suggested that participants' questions often did not target material that was on the later criterion test, which may explain why self-testing was not beneficial. The present study suggests that testing may not benefit learning if students create their own test questions. (PsycInfo Database Record (c) 2023 APA, all rights reserved).