While chiral spin structures stabilized by Dzyaloshinskii-Moriya interaction (DMI) are candidates as novel information carriers, their dynamics on the fs-ps timescale is little known. Since with the bulk Heisenberg exchange and the interfacial DMI two distinct exchange mechanisms are at play, the ultrafast dynamics of the chiral order needs to be ascertained and compared to the dynamics of the conventional collinear order. Using an XUV free-electron laser we determine the fs-ps temporal evolution of the chiral order in domain walls in a magnetic thin film sample by an IR pump - X-ray magnetic scattering probe experiment. Upon demagnetization we observe that the dichroic (CL-CR) signal connected with the chiral order correlator mzmx in the domain walls recovers significantly faster than the (CL + CR) sum signal representing the average collinear domain magnetization mz2 + mx2. We explore possible explanations based on spin structure dynamics and reduced transversal magnetization fluctuations inside the domain walls and find that the latter can explain the experimental data leading to different dynamics for collinear magnetic order and chiral magnetic order.