Identification and quality assurance of stem cells cultured in heterogeneous cell populations are indispensable for successful stem cell therapy. Here we present an image-processing pipeline for automated identification and quality assessment of human keratinocyte stem cells. When cultivated under appropriate conditions, human epidermal keratinocyte stem cells give rise to colonies and exhibit higher locomotive capacity as well as significant proliferative potential. Image processing and kernel density estimation were used to automatically extract the area of keratinocyte colonies from phase-contrast images of cultures containing feeder cells. The DeepFlow algorithm was then used to calculate locomotion speed of the colony area by analyzing serial images. This image-processing pipeline successfully identified keratinocyte stem cell colonies by measuring cell locomotion speed, and also assessed the effect of oligotrophic culture conditions and chemical inhibitors on keratinocyte behavior. Therefore, this study provides automated procedures for image-based quality control of stem cell cultures and high-throughput screening of small molecules targeting stem cells.