Androgen receptor (AR), as a member of the nuclear receptor (NR) superfamily, regulates the gene transcription in response to the sequential binding of diverse agonists and coactivators. Great progress has been made in studies on the pharmacology and structure of AR, but the atomic level mechanism of the bidirectional communications between the ligand-binding pocket (LBP) and the activation function-2 (AF2) region of AR remains poorly understood. Therefore, in this study, molecular dynamics (MD) simulations and free energy calculations were carried out to explore the interactions among water, agonist (DHT) or antagonist (HFT), AR, and coactivator (SRC3). Upon the binding of an agonist (DHT) or antagonist (HFT), the LBP structure would transform to the agonistic or antagonistic state, and the conformational changes of the LBP would regulate the structure of the AF2 surface. As a result, the binding of the androgen DHT could promote the recruitment of the coactivator SRC3 to the AF2, and on the contrary, the binding of the antagonist HFT would induce a perturbation to the shape of the AF2 and then weaken its accommodating capability of the coactivators with the LXXLL motif. The simulation results illustrated that the DHT-AR binding affinity was enhanced by the association of the coactivator SRC3, which would reduce the conformational fluctuation of the AR-LBD and expand the size of the AR LBP. On the other hand, the coactivator-to-HFT allosteric pathway, which involves the SRC3, helix 3 (H3), helix 4 (H4), the loop (L1-3) between helix 1 (H1) and H3, and HFT, was characterized. The HFT's skewness and different interactions between HFT and the LBP were observed in the SRC3-present AR. The mutual communications between the AF2 surface and LBP, together with the processes involving the interplay of the ligand binding and coactivator recruitment events, would help in understanding the association of coactivators and rationally develop potent drugs to inhibit the activity of AR.