Evaluating and quantifying the upper-limb functions are essential to planning effective patient rehabilitation. The box and block test (BBT) is a conventional, simple, and easy-to-apply assessment tool that is used in hospitals, and previous studies have demonstrated its usefulness in stroke rehabilitation. Using a conventional depth-sensing camera, the authors developed a virtual box and block test (VBBT) system for hand, finger, and grasping assessments based on the BBT used for the grasping ability test in hospitals. Such a virtual upper-limb-function assessment tool that can be implemented in a home setting could be a key component in a home-based virtual rehabilitation system. Comparison results between the real and virtual BBTs show the possibilities for virtualizing conventional and unsupervised assessments.