During the global epidemic, non-contact methods for monitoring the vital signs of several people have become particularly important. Advanced signal processing techniques have recently been demonstrated to separate and track the vital signs of multiple people. In this paper, we further develop the multi-person vital signs identification (VSign-ID) system to make non-contact detection available in public places. VSign-ID not only extracts multi-person vital signs but also states from whom these vital signs are collected. We utilize multiple doppler radars to expand the effective range of the measurement area and propose a space and time matching mechanism for vital signs identification. We use a thermal camera to detect the number of people and their movements. VSign-ID efficiently coordinates these two types of sensors (i.e., the doppler radars and the thermal camera) to track and identify the respiration rates and heartbeat rates of multiple people. A series of experiments and simulations are conducted to measure the efficiency of VSign-ID. In the case of five people sitting closely, the estimation errors for respiration and heartbeat rates are -4.85 dB and -2.36 dB lower than the standard resolution of the system, respectively, despite using only two independent radars.