Cylindrical vector beam (CVB) multiplexing communication demands effective mode cross-connection techniques to establish communication networks. While methods like polarized grating and coordinate transformation have been developed for (de)multiplexing CVB modes, challenges persist in the cross-connection of these multiplexed mode channels, including multi-mode conversion and inhomogeneous polarization control. Herein, we present an independent off-axis spin-orbit interaction strategy utilizing spin-decoupled metasurfaces. Cross-connection is achieved by encoding conjugated Dammann optical vortex grating phases onto the two orthogonal circularly polarized components of CVBs. Experimental results demonstrate the successful interconversion of four CVB modes (CVB+1 and CVB-2, CVB+2 and CVB-4) using a Si-based metasurface with a polarization conversion efficiency exceeding 85%. This facilitates the cross-connection of 200 Gbit/s quadrature phase-shift keying signals with bit-error-rates below 10-6. Offering advantages such as ultra-compact device size, flexible control of CVB modes, and multi-mode parallel processing, this approach shows promise in advancing the networking capabilities of CVB mode multiplexing communication networks.