Replacing alkali metals (K, Na atoms) by an alkaline-earth metal (Ba atom), α-Ba3Sc2(BO3)4 (high-temperature phase) is successfully obtained by a molten salt method, taking Ba2K1.6Na0.4Sc2(BO3)4 as the parent template. Although both of them exhibit similar layered structures composed of ScO6 and BO3 units, α-Ba3Sc2(BO3)4 shows largely distorted ScO6 octahedra (Δd = 0.56) forced by the uniform tension of a larger space effect from BaO12 polyhedrons, rather than regular ScO6 octahedra like in Ba2K1.6Na0.4Sc2(BO3)4. Experimental measurements and calculated analyses elucidate that distorted ScO6 octahedra in α-Ba3Sc2(BO3)4, displaying a second-order Jahn-Teller (SOJT) effect, enlarge the experimental birefringence up to 0.14@550 nm, while Ba2K1.6Na0.4Sc2(BO3)4 with regular ScO6 octahedra only shows Δn = 0.11 under the same condition. In addition, other optical and thermal properties of the two title compounds were characterized. The experimental results indicate that Ba2K1.6Na0.4Sc2(BO3)4 and α-Ba3Sc2(BO3)4 are promising birefringent materials.