Despite great success in cancer immunotherapy, immune checkpoint-targeting drugs are not the most popular weapon in the armory of cancer therapy. Accumulating evidence suggests that the tumor immune microenvironment plays a critical role in anti-cancer immunity, which may result in immune checkpoint blockade therapy being ineffective, in addition to other novel immunotherapies in cancer patients. In the present review, we discuss the deficiencies of current cancer immunotherapies. More importantly, we highlight the critical role of tumor immune microenvironment regulators in tumor immune surveillance, immunological evasion, and the potential for their further translation into clinical practice. Based on their general targetability in clinical therapy, we believe that tumor immune microenvironment regulators are promising cancer immunotherapeutic targets. Targeting the tumor immune microenvironment, alone or in combination with immune checkpoint-targeting drugs, might benefit cancer patients in the future.