In this paper, we improve the learned digital back propagation (LDBP) and propose a novel joint intra and inter-channel nonlinearity compensation scheme for polarization division multiplexing wavelength-division multiplexed (PDM-WDM) systems. From the perspective of interpretable neural network, the scheme realizes the alternating compensation of chromatic dispersion (CD) and nonlinearity based on physical models. The chromatic dispersion compensation (CDC) adopts one-dimensional convolution operation in the time domain. Moreover, the pulse-broadening effect is introduced into the overlap-and-save method. For nonlinear compensation, the improved joint model is applied, and the impact of the intra-channel pulse broadening and the walk-off effect between different channels caused by CD on the nonlinear effect is considered. To validate the effectiveness of the proposed scheme, we construct an 11-channel simulation system of 36 GBaud PDM uniform 16 quadrature amplitude modulation (PDM-16QAM) 1600 km and 64 GBaud PDM-64QAM 400 km, as well as a 5-channel experimental system of 28 GBaud PDM-16QAM 806.4 km. The simulation results show that the performance of PDM-16QAM with 0.5 steps per span and PDM-64QAM with 2 steps per span improve the Q-factor by approximately 0.75 dB and 0.54 dB at the optimal launch power, compared with the linear compensation scheme. The transmission performance of PDM-16QAM is higher than that of digital back propagation with 5 steps per span (DBP-5StPS), and the complexity is only 31.36% of that of DBP-5StPS. The performance of PDM-64QAM is higher than that of DBP-10StPS, with a complexity of 62.72%. The experimental results show that the performance of PDM-16QAM with 0.5 steps per span is improved with 0.86 dB Q-factor improvement compared with the linear compensation scheme at the optimal launch power, and the performance of the proposed scheme is higher than that of DBP-5StPS with a complexity of only 23.68%.