Heat shock protein 90 (Hsp90) is one of the most abundant cellular proteins and plays a substantial role in the folding of client proteins. The inhibition of Hsp90 has been regarded as an attractive therapeutic strategy for treating cancer because many oncogenic kinases are Hsp90 client proteins. In this study, we report new inhibitors that directly bind to N-terminal ATP-binding pocket of Hsp90. Optimized structure-based virtual screening predicted candidate molecules, which was followed by confirmation using biophysical and cell-based assays. Among the reported crystal structures, we chose the two structures that show the most favourable early enrichments of true-positives in the receiver operating characteristic curve. Four molecules showed significant changes in the signals of 2D [1H, 15N] correlation NMR spectroscopy. Differential scanning calorimetry analysis supported the results indicating direct binding. Quantified dissociation constant values of the molecules, determined by a series of 2D NMR experiments, lie in the range of 0.1-33 μM. Growth inhibition assay with breast and lung cancer cells confirmed the cellular activities of the molecules. Cheminformatics revealed that the molecules share limited chemical similarities with known inhibitors. Molecular dynamics simulations detailed the putative binding modes of the inhibitors.