Selection of the best applicants for orthopaedic residency programs remains a difficult problem. Most quantifiable factors for residency selection evaluate test-taking ability and grades rather than other aspects, such as patient care, professionalism, moral reasoning, and integrity. Four current department members on our resident selection committee ranked four consecutive classes of orthopaedic residents interviewed for residency. We ranked incoming residents in order of best to least qualified and compared those rankings with rank lists by the same faculty on completion of residency. Rankings also were compared with the residents' United States Medical Licensing Examination (USMLE) Part I scores, American Board of Orthopaedic Surgery (ABOS) Part I scores, and fourth-year Orthopaedic-in-Training Examination (OITE) scores. We found fair or poor correlations between the residents' initial rankings, rankings on graduation, and their USMLE, ABOS, and OITE scores. The only relatively strong correlation found was between the OITE and ABOS scores. Despite the faculty's consensus regarding selection criteria, interviewers did not agree in their rankings of residents on graduation. Additional work is necessary to refine the inexact yet important science of selecting residency applicants.