Context: Doctors have used the subjective-objective-assessment-plan (SOAP) note format to organise data about patient problems and create plans to address each of them. We retooled this into the 'Programme Evaluation SOAP Note', which serves to broaden the clinician faculty member's perspective on programme evaluation to include the curriculum and the system, as well as students.
Methods: The SOAP Note was chosen as the method for data recording because of its familiarity to clinician-educators and its strengths as a representation of a clinical problem-solving process with elements analogous to educational programme evaluation. We pilot-tested the Programme Evaluation SOAP Note to organise faculty members' interpretations of integrated student performances during the Year 3 patient care skills objective structured clinical examination (OSCE).
Results: Eight community clerkship directors and lead clerkship faculty members participated as observers in the 2007 gateway examination and completed the Programme Evaluation SOAP Note. Problems with the curriculum and system far outnumbered problems identified with students.
Conclusions: Using the Programme Evaluation SOAP Note, clerkship leaders developed expanded lists of 'differential diagnoses' that could explain possible learner performance inadequacies in terms of system, curriculum and learner problems. This has informed programme improvement efforts currently underway. We plan to continue using the Programme Evaluation SOAP Note for ongoing programme improvement.