The magnetic symmetry and structure of the non-Fermi liquid heavy fermion compound CeNiGa2 has been determined by neutron powder diffraction. The orthorhombic CeNiGa2 compound orders antiferromagnetically below 4.4(2) K at ambient pressure with a magnetic moment magnitude of μCe = 0.80(4) μB for moments aligned along the c-axis. The magnetic (Shubnikov) space group is C2cm'm'm. The nature of the magnetic order of CeNiGa2 is further elucidated by neutron diffraction at elevated pressures up to 4.5 kbar, allowing for the confirmation of a critical pressure PC of about 4.2(2) kbar above which the magnetic moment ordering is suppressed.