This study reports the first systematic approach to the excitation of all high-order Hermite-Gaussian modes (HGMs) in end-pumped solid-state lasers. This study uses a metal-wire-inserted laser resonator accompanied with the "off axis pumping" approach. This study presents numerical analysis of the excitation of HGMs in end-pumped solid-state lasers and experimentally generated HGM patterns. This study also experimentally demonstrates the generation of an square vortex array laser beams by passing specific high-order HGMs (HGn,n + 1 or HGn + 1,n modes) through a Dove prism-embedded unbalanced Mach-Zehnder interferometer [Optics Express 16, 19934-19949]. The resulting square vortex array laser beams with embedded vortexes aligned in a square array can be applied to multi-spot dark optical traps in the future.