The large size of poxvirus genomes has stymied attempts to identify determinants recognized by CD8+ T cells and greatly impeded development of mouse smallpox vaccination models. Here, we use a vaccinia virus (VACV) expression library containing each of the predicted 258 open reading frames to identify five peptide determinants that account for approximately half of the VACV-specific CD8+ T cell response in C57BL/6 mice. We show that the primary immunodominance hierarchy is greatly affected by the route of VACV infection and the poxvirus strain used. Modified vaccinia virus ankara (MVA), a candidate replacement smallpox vaccine, failed to induce responses to two of the defined determinants. This could not be predicted by genomic comparison of viruses and is not due strictly to limited MVA replication in mice. Several determinants are immunogenic in cowpox and ectromelia (mousepox) virus infections, and immunization with the immunodominant determinant provided significant protection against lethal mousepox. These findings have important implications for understanding poxvirus immunity in animal models and bench-marking immune responses to poxvirus vaccines in humans.