Various robotic devices have been developed for home rehabilitation and support of therapists. Special attention has been focused on soft actuators due to their high viscoelasticity and flexibility, which can contribute to the safety and affinity with the users. However, most of them aimed at the assist of finger flexion, and few have been designed to support extension actively. Moreover, for most soft actuator based mechanisms, the individual-adaptability have not been considered nor appropriately evaluated. Consequently, the effect of individual difference on the assistance using soft robotic devices is unclear, and for the purpose of dealing with the individual difference, the whole mechanism should be designed and fabricated for each individual user, which is ineffective for the rehabilitation support. In this study, we proposed a hybrid soft mechanism with modularized fiber-reinforced elastomer actuators for joint-dependent flexion support and McKibben actuators for finger extension support. Without further changing the design of the elastomer actuator, the hybrid mechanism could be adapted to individual hand difference: proportions of hand segments, range of motion (ROM) and torque characteristics of the joints. A prototype of the mechanism was fabricated and evaluated. The results showed that the mechanism could meet the requirement of finger function assist. Moreover, the mechanism could be fine-tuned towards the individual hand by changing the fiber-reinforcement and adjusting the fittings of the actuators.