Microwave radar imaging is promising as a complementary medical imaging modality. However, the unique nature of the images means interpretation can be difficult. As a result, it is important to understand the sources of image differences, and how much variability is inherent in the imaging system itself. To address this issue, we compare the effectiveness of six different measures of image similarity for quantifying the similarity (or difference) between two microwave radar images. The structural similarity index has become the de facto standard for image comparison, but we propose that useful information can be acquired from a measure known as the Modified Hausdorff Distance. We apply each measure to image pairs from sequential scans of both phantoms and volunteers. We find that rather than using a single value to quantify the image similarity, by computing a number of values that are designed to capture different image aspects, we can better assess the ways in which the images differ.