The literature is controversial about the scan direction dependency of interplay effects in pencil beam scanning (PBS) treatment of moving targets. A directional effect is supported by many simulation studies, whereas the experimental data are mostly limited to simple geometries, not reflecting realistically clinical treatment plans. We have compared increasingly complex treatment fields, from a homogeneous single energy layer to a more modulated lung plan, under identical experimental settings, seeking evidence for differences in motion mitigation due to the selection of primary scanning direction. In total, 120 experimental samples were taken, combining two primary scan directions and three rescanning regimes with different motion scenarios. 4D dose distributions were measured in water with a moving ionisation chamber array and compared to those of a stationary delivery using 2D gamma analysis. Each plan has been verified twice for the same rescanning regime and motion scenario, changing the meandering direction in between to scan perpendicularly to, or along, the target motion. Additionally, machine log files of the lung plan, together with 4DCT data, were used to calculate the dose distribution that such deliveries would have produced in the patient. The primary meandering direction has a clear influence on measured dose distributions when considering a single energy layer. Introducing spot weight modulation and multiple energy layers however, makes the dynamic of interplay more complex and difficult to predict. Overall, gamma (3%/3 mm) differences between scanning along or orthogonal to the target motion follow a normal distribution [Formula: see text] when considering multiple motion scenarios and rescanning regimes. Nevertheless, data spread [Formula: see text] is significant enough such that, for individual experiments and set-ups, a dependency may be observed even if this is not a general result. Patient reconstructed doses follow the same trend, the two primary scan directions producing statistically insignificant differences in dose distributions in terms of conformity or homogeneity. Except for extremely simplified cases of mono-energetic and homogeneous treatment fields, the interplay effect has been found to be only marginally influenced by the choice of the primary scanning direction.