We experimentally and theoretically study high-order harmonic generation in zinc oxide crystals irradiated by mid-infrared lasers. The trajectories are mapped to the far field spatial distribution of harmonics. The divergence angles of on-axis and off-axis parts exhibit different dependences on the order of the harmonics. This observation can be theoretically reproduced by the coherent interference between the short and long trajectories with dephasing time longer than 0.5 optical cycle. Further, the relative contribution of the short and long trajectories is demonstrated to be accurately controlled by a one-color or two-color laser on the attosecond time scale. This work provides a reliable method to determine the electron dephasing time and demonstrates a versatile control of trajectory interference in the solid high-order harmonic generation.