Accurate detection of breast malignancy from histologically normal cells ("field effect") has significant clinical implications in a broad base of breast cancer management, such as high-risk lesion management, personalized risk assessment, breast tumor recurrence, and tumor margin management. More accurate and clinically applicable tools to detect markers characteristic of breast cancer "field effect" that are able to guide the clinical management are urgently needed. We have recently developed a novel optical microscope, spatial-domain low-coherence quantitative phase microscopy, which extracts the nanoscale structural characteristics of cell nuclei (i.e., nuclear nano-morphology markers), using standard histology slides. In this proof-of-concept study, we present the use of these highly sensitive nuclear nano-morphology markers to identify breast malignancy from histologically normal cells. We investigated the nano-morphology markers from 154 patients with a broad spectrum of breast pathology entities, including normal breast tissue, non-proliferative benign lesions, proliferative lesions (without and with atypia), "malignant-adjacent" normal tissue, and invasive carcinoma. Our results show that the nuclear nano-morphology markers of "malignant-adjacent" normal tissue can detect the presence of invasive breast carcinoma with high accuracy and do not reflect normal aging. Further, we found that a progressive change in nuclear nano-morphology markers that parallel breast cancer risk, suggesting its potential use for risk stratification. These novel nano-morphology markers that detect breast cancerous changes from nanoscale structural characteristics of histologically normal cells could potentially benefit the diagnosis, risk assessment, prognosis, prevention, and treatment of breast cancer.