Cholangiocarcinoma (CCA) is an aggressive and heterogeneous malignancy of the biliary tree. A typical hallmark of CCA is that cancer cells are embedded into a dense stroma containing fibrogenic cells, lymphatics and a variety of immune cells. Functional roles of the reactive tumor stroma are not fully elucidated; however, recent studies suggest that the tumor microenvironment plays a key role in the progression and invasiveness of CCA. CCA cells exchange autocrine/paracrine signals with other cancer cells and the infiltrating cell types that populate the microenvironment. This crosstalk is under the control of signals mediated by various cytokines, chemokines, and growth factors. In addition, extracellular vesicles (EVs), exosomes and microvesicles, containing cargo mediators, such as proteins and RNAs, play a key role in cell-to-cell communication, and particularly in epigenetic regulation thanks to their content in miRNAs. Both cytokine- and EV-mediated communications between CCA cells and other liver cells provide a potential novel target for the management of CCA. This review summarizes current understandings of the tumor microenvironment and intercellular communications in CCA and their role in tumor progression.