Gold nanoparticles (AuNPs) with diverse physicochemical properties are reported to affect biological systems differently, but the relationship between the physicochemical properties of AuNPs and their biological effects is not clearly understood. Here, we aimed to elucidate the molecular origins of AuNP-induced cytotoxicity and their mechanisms, focusing on the surface charge and structural properties of modified AuNPs. We prepared a library of well-tailored AuNPs exhibiting various functional groups and surface charges. Through this work, we revealed that the direction or the magnitude of surface charge is not an exclusive factor that determines the cytotoxicity of AuNPs. We, instead, suggested that toxic AuNPs share a common structural characteristics of a hydrophobic moiety neighbouring the positive charge, which can induce lytic interaction with plasma membrane. Mechanistic study showed that the toxic AuNPs interfered with the formation of cytoskeletal structure to slow cell migration, inhibited DNA replication and caused DNA damage via oxidative stress to hinder cell proliferation. Gene expression analysis showed that the toxic AuNPs down-regulated genes associated with cell cycle processes. We discovered structural characteristics that define the cytotoxic AuNPs and suggested the mechanisms of their cytotoxicity. These findings will help us to understand and to predict the biological effects of modified AuNPs based on their physicochemical properties.