Recently, deep learning (DL) has shown great potential in complex wavefront retrieval (CWR). However, the application of DL in CWR does not match well with the physical diffraction process. The state-of-the-art DL-based CWR methods crop full-size diffraction patterns down to a smaller size to save computational resources. However, cropping reduces the space-bandwidth product (SBP). In order to solve the trade-off between computational resources and SBP, we propose an imaging process matched neural network (IPMnet). IPMnet accepts full-size diffraction patterns with a larger SBP as inputs and retrieves a higher resolution and a larger field of view of the complex wavefront. We verify the effectiveness of the proposed IPMnet through simulations and experiments.