Inhomogeneous swelling of polymer films in liquid environments may find applications in soft actuators and sensors. Among them, fluoroelastomer based films bend up spontaneously once they are placed on an acetone-soaked filter paper. The stretchability and dielectric properties of a fluoroelastomer is attractive in the fields of soft actuators and sensors, making in-depth studies on and understanding of fluoroelastomer bending behaviors important. Here, we report an abnormal size-dependent bending phenomenon of rectangular fluoroelastomer films, which transform the bending direction from the long-side bending to the short-side bending as their length or width increases or the thickness decreases. By using finite element analysis and an analytical expression obtained using a bilayer model, we reveal the key role of gravity in determining the size-dependent bending behavior. In the bilayer model, an energy quantity is obtained to characterize the role of each material and geometrical parameters in determining the size-dependent bending behavior. We further construct phase diagrams to correlate the bending modes and the film sizes based on the finite element results, which are in good agreement with experimental results. These findings can be useful for the design of future swelling-based polymer actuators and sensors.