Identification of a drug mechanism is vital for drug development. However, it often resorts to the expensive and cumbersome omics methods along with complex data analysis. Herein, we developed a methodology to analyze organelle staining images of single cells using a deep learning algorithm (TL-ResNet50) for rapid and accurate identification of different drug mechanisms. Based on the organelle-related cell morphological changes caused by drug action, the constructed deep learning model can fast predict the drug mechanism with a high accuracy of 92%. Further analysis reveals that drug combination at different ratios can enhance a certain mechanism or generate a new mechanism. This work would highly facilitate clinical medication and drug screening.