A lack of fine, spatially-resolute case data for the U.S. has prevented the examination of how COVID-19 burden has been distributed across neighborhoods, a known geographic unit of both risk and resilience, and is hampering efforts to identify and mitigate the long-term fallout from COVID-19 in vulnerable communities. Using spatially-referenced data from 21 states at the ZIP code or census tract level, we documented how the distribution of COVID-19 at the neighborhood-level varies significantly within and between states. The median case count per neighborhood (IQR) in Oregon was 3,608 (2,487) per 100,000 population, indicating a more homogenous distribution of COVID-19 burden, whereas in Vermont the median case count per neighborhood (IQR) was 8,142 (11,031) per 100,000. We also found that the association between features of the neighborhood social environment and burden varied in magnitude and direction by state. Our findings underscore the importance of local contexts when addressing the long-term social and economic fallout communities will face from COVID-19.