Patient-derived tumor organoids (PDTOs) hold great promise for preclinical and translational research and predicting the patient therapy response from ex vivo drug screenings. However, current adenosine triphosphate (ATP)-based drug screening assays do not capture the complexity of a drug response (cytostatic or cytotoxic) and intratumor heterogeneity that has been shown to be retained in PDTOs due to a bulk readout. Live-cell imaging is a powerful tool to overcome this issue and visualize drug responses more in-depth. However, image analysis software is often not adapted to the three-dimensionality of PDTOs, requires fluorescent viability dyes, or is not compatible with a 384-well microplate format. This paper describes a semi-automated methodology to seed, treat, and image PDTOs in a high-throughput, 384-well format using conventional, widefield, live-cell imaging systems. In addition, we developed viability marker-free image analysis software to quantify growth rate-based drug response metrics that improve reproducibility and correct growth rate variations between different PDTO lines. Using the normalized drug response metric, which scores drug response based on the growth rate normalized to a positive and negative control condition, and a fluorescent cell death dye, cytotoxic and cytostatic drug responses can be easily distinguished, profoundly improving the classification of responders and non-responders. In addition, drug-response heterogeneity can by quantified from single-organoid drug response analysis to identify potential, resistant clones. Ultimately, this method aims to improve the prediction of clinical therapy response by capturing a multiparametric drug response signature, which includes kinetic growth arrest and cell death quantification.