Both in vivo and ex vivo observations support the hypothesis that bone mineral formation proceeds via disordered precursor phases. The characteristics of the precursor phases are not well defined, but octacalcium phosphate-like, amorphous calcium phosphate-like, and HPO42--enriched phases were detected. Here we use in vivo Raman spectroscopy and high-resolution wide-angle X-ray diffraction (WAXD) to characterize and map at 2 μm resolution the mineral phases in the rapidly forming tail fin bones of living zebrafish larvae and zebrafish larvae immediately after sacrifice, respectively. Raman spectroscopy shows the presence of an acidic disordered calcium phosphate phase with additional characteristic features of HPO42- at the bone-cell interface. The complexity in the position and shape of the ν1 PO4 peak viewed by in vivo Raman spectroscopy emphasizes the heterogeneity of the mineral during bone formation. WAXD detects an additional isolated peak, appearing alone or together with the characteristic diffraction pattern of carbonated hydroxyapatite. This unidentified phase is located at the interface between the mature bone and the surrounding tissue, similar to the location at which the disordered phase was observed by Raman spectroscopy. The variable peak positions and profiles support the notion that this is an unstable disordered precursor phase, which conceivably crystallized during the X-ray diffraction measurement. Interestingly, this precursor phase is co-aligned with the c-axes of the mature bone crystals and thus is in intimate relation with the surrounding collagen matrix. We conclude that a major disordered precursor mineral phase containing HPO42- is part of the deposition pathway of the rapidly forming tail fin bones of the zebrafish.