The diagnosis and treatment of fatty liver disease requires accurate quantification of the amount of fat in the liver. Image-based methods for quantification of liver fat are of increasing interest due to the high sampling error and invasiveness associated with liver biopsy, which despite these difficulties remains the gold standard. Current computed tomography (CT) methods for liver-fat quantification are only semi-quantitative and infer the concentration of liver fat heuristically. Furthermore, these techniques are only applicable to images acquired without the use of contrast agent, even though contrast-enhanced CT imaging is more prevalent in clinical practice. In this paper, we introduce a method that allows for direct quantification of liver fat for both contrast-free and contrast- enhanced CT images. Phantom and patient data are used for validation, and we conclude that our algorithm allows for highly accurate and repeatable quantification of liver fat for spectral CT.