Agitation is a significant problem in the Intensive Care Unit (ICU), affecting 71% of sedated adult patients during 58% of ICU patient-days. Subjective scale based assessment-methods focused primarily on assessing excessive patient motion are currently used to assess the level of patient agitation, but are limited in their accuracy and resolution. This research quantifies this approach by developing an objective agitation measurement from patient motion that is sensed using digital video image processing. A fuzzy inference system (FIS) is developed to classify levels of motion that correlate with observed patient agitation, while accounting for motion due to medical staff working on the patient. Clinical tests for five ICU patients have been performed to verify the validity of this approach in comparison to agitation graded by nursing staff using the Riker Sedation-Agitation Scale (SAS). All trials were performed in the Christchurch Hospital Department of Intensive Care, with ethics approval from the Canterbury Ethics Committee. Results show good correlation with medical staff assessment with no false positive results during calm periods. Clinically, this initial agitation measurement method promises the ability to consistently and objectively quantify patient agitation to enable better management of sedation and agitation through optimised drug delivery leading to reduced length of stay and improved outcome.