Hip fractures among the elderly are a worldwide problem. The objective of this study was (1) to confirm whether or not differences in bone strength are reflected in the proximal femur finite element (FE) model constructed from CT images of healthy subjects and osteoporosis patients, and (2) to investigate the effect of loading angle direction on bone fractures. The results from comparison of bone strength between the fracture group, fragile group (osteoporosis patients with no fracture after falling), and healthy group showed that differences in bone strength were definitely reflected in this FE model. Furthermore, the relationship between the loading direction and fracture load value was significant in all groups in the age-adjusted general linear model, and the model made from the trochanteric fracture patients was more sensitive to loading direction than those from cervical neck fracture. No significant differences were observed in the age-corrected comparison of DXA Neck BMD, Wards BMD, and total BMD in these two groups. The difference in the trochanteric BMD showed a trend of low bone density in the trochanteric fracture group. There is thus a possibility that the bone density at this location is implicated in the fragility under certain loading directions.