The reference-frame-independent quantum key distribution (RFI-QKD) has the advantage of tolerating reference frames that slowly vary. It can generate secure keys between two remote users with slowly drifted and unknown reference frames. However, the drift of reference frames may inevitably compromise the performance of QKD systems. In the paper, we employ the advantage distillation technology (ADT) to the RFI-QKD and the RFI measurement-device-independent QKD (RFI MDI-QKD), and we then analyze the effect of ADT on the performance of decoy-state RFI-QKD and RFI MDI-QKD in both asymptotic and nonasymptotic cases. The simulation results show that ADT can significantly improve the maximum transmission distance and the maximum tolerable background error rate. Furthermore, the performance of RFI-QKD and RFI MDI-QKD in terms of the secret key rate and maximum transmission distance are still greatly improved when statistical fluctuations are taken into account. Our work combines the merits of the ADT and RFI-QKD protocols, which further enhances the robustness and practicability of QKD systems.