Metamaterials-based multispectral camouflage has attracted growing interest in most fields of military and aerospace due to its unprecedented emission adjustability covering an ultra-broadband spectral range. Conventional camouflage mainly concentrates on an individual spectral range, e. g. either of visible, mid-wavelength-infrared (MWIR) or long-wavelength-infrared (LWIR), which is especially incapable of self-adaptive thermal camouflage to the changing ambient environment. Here, we theoretically demonstrate a multispectral camouflage metamaterial consisting of a four-layer titanium/silicon/vanadium dioxide/ titanium (Ti/Si/VO2/Ti) nanostructure, where the background temperature-adaptive thermal camouflage is implemented by exploiting the switchable metal/dielectric state of the phase-changing material VO2 for regulating the infrared emissivity of the designed metamaterial, whilst visible color camouflage is also achieved by tuning thickness of middle Si layer to match the background's appearance. It has been shown that the designed metamaterial with the dielectric state of VO2 enables thermal camouflage of high background temperature by increasing the thermal emission (average emissivity of 0.69/0.83 for MWIR/LWIR range), meanwhile, the metamaterial of the metallic state of VO2 for low background temperature thermal camouflage stemming from low emission (average emissivity of 0.29 for both MWIR/LWIR range) due to high infrared reflection. Furthermore, the designed metamaterial structural color is robust for a phase change switching. This proposed adaptive camouflage provides a potential strategy to broaden dynamical camouflage technology for further practical application in the fields of military and civilian.