Continuous-variable quantum key distribution (CVQKD) holds an advantage of well compatibility with classical coherent optical communications. However, there exists a performance trade-off between CVQKD and classical communication on single-mode fiber (SMF) because of the spontaneous Raman scattering. Space-division multiplexing (SDM) technique may provide a feasible way to mitigate this performance trade-off in short-distance communication while CVQKD coexisting with classical signals on few-mode fiber (FMF). Here, we examine the feasibility of CVQKD coexisting with classical signals on FMF and analyze the noise impact in weak coupling regime. We find that the inter-mode crosstalk generated from the mode coupling and re-coupling between modes and the group delay spread originated from the differential group delay (DGD) contribute the main noise sources. DGD may become one of the main limits for FMF-based CVQKD towards high-speed system. In addition, a well channel wavelength management is needed to suppress the inter-mode four-wave-mixing for achieving the positive secret key rates. The numerical simulations identify the key parameters for CVQKD system, enabling a helpful insight for realizing security analysis of the Gaussian modulated coherent state protocol. It shows that CVQKD coexisting with high power classical signals on FMF is feasible to implement with standard telecommunication components and able to operate at higher secret key rates. The results may provide a potential guideline for the practical high-rate CVQKD integrating with the FMF-based configuration.