This paper presents the main findings of a field survey conducted in the United Kingdom into the human response to vibration in residential environments. The main aim of this study was to derive exposure-response relationships for annoyance due to vibration from environmental sources. The sources of vibration considered in this paper are railway and construction activity. Annoyance data were collected using questionnaires conducted face-to-face with residents in their own homes. Questionnaires were completed with residents exposed to railway induced vibration (N = 931) and vibration from the construction of a light rail system (N = 350). Measurements of vibration were conducted at internal and external positions from which estimates of 24-h vibration exposure were derived for 1073 of the case studies. Sixty different vibration exposure descriptors along with 6 different frequency weightings were assessed as potential predictors of annoyance. Of the exposure descriptors considered, none were found to be a better predictor of annoyance than any other. However, use of relevant frequency weightings was found to improve correlation between vibration exposure and annoyance. A unified exposure-response relationship could not be derived due to differences in response to the two sources so separate relationships are presented for each source.