We report the lattice site and symmetry of optically active Dy3+ and Tm3+ implanted Si. Local symmetry was determined by fitting crystal field parameters (CFPs), corresponding to various common symmetries, to the ground state splitting determined by photoluminescence measurements. These CFP values were then used to calculate the splitting of every J manifold. We find that both Dy and Tm ions are in a Si substitution site with local tetragonal symmetry. Knowledge of rare-earth ion symmetry is important in maximising the number of optically active centres and for quantum technology applications where local symmetry can be used to control decoherence.