RNA duplexes are relatively rare but play very important biological roles. As an end-product of template-based RNA replication, they also have key implications for hypothetical primitive forms of life. Unless they are specifically separated by enzymes, these duplexes denature upon a temperature increase. However, mechanistic and kinetic aspects of RNA (and DNA) duplex thermal denaturation remain unclear at the microscopic level. We propose an in silico strategy that probes the thermal denaturation of RNA duplexes and allows for an extensive conformational space exploration along a wide temperature range with atomistic precision. We show that this approach first accounts for the strong sequence and length dependence of the duplexes melting temperature, reproducing the trends seen in the experiments and predicted by nearest-neighbor models. The simulations are then instrumental at providing a molecular picture of the temperature-induced strand separation. The textbook canonical "all-or-nothing" two-state model, very much inspired by the protein folding mechanism, can be nuanced. We demonstrate that a temperature increase leads to significantly distorted but stable structures with extensive base-fraying at the extremities, and that the fully formed duplexes typically do not form around melting. The duplex separation therefore appears as much more gradual than commonly thought.