Dynamic color tuning has significant application prospects in the fields of color display, steganography, and information encryption. However, most methods for color switching require external stimuli, which increases the structural complexity and hinders the applicability of front-end dynamic display technology. In this study, we propose polarization-controlled hybrid metal-dielectric metasurfaces to realize full-color display and dynamic color tuning by altering the polarization angle of incident light without changing the structure and properties of the material. A bidirectional neural network is trained to predict the colors of mixed metasurfaces and inversely design the geometric parameters for the desired colors, which is less dependent on design experience and reduces the computational cost. According to the color recognition ability of human eyes, the accuracy of color prediction realized in our study is 93.18% and that of inverse parameter design is 92.37%. This study presents a simple method for dynamic structural color tuning and accelerating the design of full-color metasurfaces, which can offer further insight into the design of color filters and promote photonics research.