Recent advances in the understating of tumor immunology suggest that cancer immunotherapy is an effective treatment against various types of cancer. In particular, the remarkable successes of immune checkpoint-blocking antibodies in clinical settings have encouraged researchers to focus on developing other various immunologic strategies to combat cancer. However, such immunotherapies still face difficulties in controlling malignancy in many patients due to the heterogeneity of both tumors and individual patients. Here, we discuss how tumor-intrinsic cues, tumor environmental metabolites, and host-derived immune cells might impact the efficacy and resistance often seen during immune checkpoint blockade treatment. Furthermore, we introduce biomarkers identified from human and mouse models that predict clinical benefits for immune checkpoint blockers in cancer.