We present a technique for fitting a smooth, locally parameterized surface model (called the manifold surface model) to unevenly scattered data describing an anatomical structure. These data are acquired from medical imaging modalities such as CT scans or MRI. The manifold surface is useful for problems which require analyzable or parametric surfaces fitted to data acquired from surfaces of arbitrary topology (e.g., entire bones). This surface modeling work is part of a larger project to model and analyze skeletal joints, in particular the complex of small bones within the wrist and hand. To demonstrate the suitability of this model we fit to several different bones in the hand, and to the same bone from multiple people.