Access to accurate and quality-controlled health information on the Internet for medical students is not an easy task. CISMeF is the search tool of a MeSH-indexed directory of medical Internet resources in French. Since 2004, a new French Pre-Residency Examination (PRE) is compulsory for all medical students in the 6th year of the curriculum. The goal of this study is to evaluate CISMeF as a tool to provide teaching resources available on the Internet covering PRE material. The CISMeF terminology and the PRE CISMeF module are described. To assess the CISMeF performance in covering PRE program, its precision (number of relevant resources/number of overall resources extracted by CISMeF) and coverage (number of PRE questions covered by at least one resource in the CISMeF gateway) were computed. The CISMeF module for the new French Pre-Residency Examination is efficient as it already covers 95.7% of the program with a precision of 82.2%. Our data demonstrates that CISMeF is acceptable to guide students' learning and should be a useful teaching resource for the preparation of the French Pre-Residency Examination.