Biomimetic synthesis of bone-like carbonated apatite with good biocompatibility is a promising strategy for the development of novel biomaterials for bone engineering applications. Most research efforts have been focused on only protein-based or only polysaccharide-based template for synthesis of apatite minerals. To understand the cooperative roles of gelatin and polysaccharide playing in the biomineralization, agar hydrogel, gelatin and agar-gelatin hybrid hydrogel were respectively introduced as mineralization matrix for the in vitro growth of apatite in the study. It was shown that bundle-like carbonated apatite was successfully prepared in agar-gelatin hybrid hydrogel for the first time, through the interaction between apatite and matrix macromolecule under physiological temperature. Moreover, the in vitro biocompatibility of the prepared nanostructured apatite crystals was investigated using CCK-8 assay and alkaline phosphatase activity of osteoblast-like MC3T3-E1. Compared with HA synthesized by traditional method, the obtained apatite in agar-gelatin hybrid hydrogel could provide significantly higher cell viability and alkaline phosphatase activity. Through the study, we could better understand the role of gelatin and polysaccharide in bone formation process, and the product is a promising candidate to be used in bone tissue engineering.