Utilization of urban green vegetation (UGV) has been recognized as a promising option to mitigate urban heat island (UHI) effect. While we still lack understanding of the contributions of local background climate to the cooling effect of UGV. Here we proposed and employed a cooling effect framework and selected eight typical cities located in Temperate Monsoon Climate (TMC) and Mediterranean Climate (MC) demonstrate that local climate condition largely affects the cooling effect of UGV. Specifically, we found increasing (artificial) rainfall and irrigation contribute to improving the cooling intensity of grassland in both climates, particularly in the hot-dry environment. The cities with high relative humidity would restrict the cooling effect of UGV. Increasing wind speed would significantly enhance the tree-covered while weakening the grass-covered UGVs' cooling effect in MC cities. We also identified that, in order to achieve the most effective cooling with the smallest sized tree-covered UGV, the area of trees in both climate zones' cities should generally be planned around 0.5 ha. The method and results enhance understanding of the cooling effect of UGVs on larger (climate) scales and provide important insights for UGV planning and management.