Despite positive associations between chronic physical activity and memory; we have little understanding of how best to incorporate physical activity during the day to facilitate the consolidation of information into memory, nor even how time spent physically active during the day relates to memory processes. The purpose of this investigation was to examine the relation between physical activity during the day and long-term memory. Ninety-two young adults learned a list of paired-associate items and were tested on the items after a 12-hour interval during which heart rate was recorded continuously. Although the percentage of time spent active during the day was unrelated to memory, two critical physical activity periods were identified as relating to the maintenance of long-term memory. Engaging in physical activity during the period 1 to 2-hours following the encoding of information was observed to be detrimental to the maintenance of information in long-term memory. In contrast, physical activity during the period 1-hour prior to memory retrieval was associated with superior memory performance, likely due to enhanced retrieval processing. These findings provide initial evidence to suggest that long-term memory may be enhanced by more carefully attending to the relative timing of physical activity incorporated during the day.