RhoA regulates cell proliferation, migration, angiogenesis and gene expression. Altered RhoA activity contributes to cancer progression. The present study investigated the effects of RhoA knockdown on the regulation of ovarian cancer biological behavior in vitro and in nude mice. The expression of RhoA was knocked down using a lentivirus carrying RhoA short hairpin RNA (shRNA) in ovarian cancer cells and was confirmed by reverse transcription-quantitative polymerase chain reaction (RT-qPCR) and western blot analysis. The altered ovarian cancer biological behaviors were assayed by cell viability, terminal deoxynucleotidyltransferase-mediated dUTP nick end-labeling (TUNEL), migration, invasion, and nude mice tumorigenicity assays, while the altered gene expression was detected by RT-qPCR and western blot analysis. The results showed that lentivirus-carrying RhoA shRNA significantly suppressed RhoA expression in ovarian cancer cells, which suppressed tumor cell viability, migration, invasion and adhesion in vitro. RhoA silencing also inhibited the tumorigenicity of ovarian cancer cells in nude mice, which was characterized by the suppression of tumor xenograft formation and growth and induction of tumor cell apoptosis. The results of the present study demonstrated that knockdown of RhoA expression had a significant antitumor effect on ovarian cancer cells in vitro and in nude mice, suggesting that RhoA may be a target for the development of a novel therapeutic strategy in the control of ovarian cancer.