The spreading of novel coronavirus (SARS-CoV-2) has gravely impacted the world in the last year and a half. Understanding the spatial and temporal patterns of how it spreads at the early stage and the effectiveness of a governments' immediate response helps our society prepare for future COVID-19 waves or the next pandemic and contain it before the spreading gets out of control. In this article, a susceptible-exposed-infectious-removed model is used to model the city-to-city spreading patterns of the disease at the early stage of its emergence in China (from December 2019 to February 2020). Publicly available reported case numbers in 312 Chinese cities and between-city mobility data are leveraged to estimate key epidemiological characteristics, such as the transmission rate and the number of infectious people for each city. It is discovered that during any given time period, there are always only a few cities that are responsible for spreading the disease to other cities. We term these few cities as transmission centers. The spatial and temporal changes in transmission centers demonstrate predictable patterns. Moreover, rigorously designed experiments show that in controlling the disease spread in a city, non-pharmaceutical interventions (NPIs) implemented at transmission centers are more effective than the NPI implemented in the city itself. These findings have implications on the control of an infectious disease at the early stage of its spreading: implementing NPIs at transmission centers at early stages is effective in controlling the spread of infectious diseases.