We propose an alternative entanglement swapping scheme based on the principle of the counterfactual quantum communication, which demonstrates nonlocal entanglement swapping can be achieved by the operations of a third party. During the whole process, it is not needed to transmit any physical particles among the participants. Furthermore, all the entangled particles are not destroyed in the counterfactual entanglement swapping process, which means we can obtain two pairs of nonlocal entanglement at the same time, thus achieve high-efficiency entanglement distribution. The numerical analysis about the performance of the presented scheme shows that this counterfactual protocol can be implemented with high success probability and fidelity in the ideal asymptotic limit. The scheme may be meaningful for large-scale quantum communication network and quantum repeater.