Interest in cognitive research in pigs is increasing, but little is known about the impact of environmental conditions on pigs' cognitive capabilities. The present study investigated the effect of environmental enrichment on cognitive performance of pigs in a holeboard spatial task, in which they had to discriminate four baited buckets out of 16. Pigs (n = 32) were either housed in stimulus-poor, barren pens, or in larger pens enriched with rooting substrates. Pigs were subjected to 30 holeboard trials. Both working memory (WM), that is, the ratio (baited visits/total number of (re)visits to baited buckets), and reference memory (RM), that is, the ratio ((re)visits to baited buckets/total number of visits to all buckets), improved over trials. WM scores were higher in pigs from enriched pens than in pigs from barren pens. Housing did not affect RM scores. Personality type of the pigs, as assessed early in life using a backtest, did not affect WM or RM. In conclusion, housing conditions of pigs did not affect reference memory, but environmental enrichment improved working memory of pigs in a spatial discrimination task. Based on the findings of this study, we suggest that cognitive functioning of pigs may be impaired under commonly used housing conditions.