The orbital relaxation attendant on ionization is particularly important for the core electron ionization potential (core IP) of molecules. The Unitary Group Adapted State Universal Coupled Cluster (UGA-SUMRCC) theory, recently formulated and implemented by Sen et al. [J. Chem. Phys. 137, 074104 (2012)], is very effective in capturing orbital relaxation accompanying ionization or excitation of both the core and the valence electrons [S. Sen et al., Mol. Phys. 111, 2625 (2013); A. Shee et al., J. Chem. Theory Comput. 9, 2573 (2013)] while preserving the spin-symmetry of the target states and using the neutral closed-shell spatial orbitals of the ground state. Our Ansatz invokes a normal-ordered exponential representation of spin-free cluster-operators. The orbital relaxation induced by a specific set of cluster operators in our Ansatz is good enough to eliminate the need for different sets of orbitals for the ground and the core-ionized states. We call the single configuration state function (CSF) limit of this theory the Unitary Group Adapted Open-Shell Coupled Cluster (UGA-OSCC) theory. The aim of this paper is to comprehensively explore the efficacy of our Ansatz to describe orbital relaxation, using both theoretical analysis and numerical performance. Whenever warranted, we also make appropriate comparisons with other coupled-cluster theories. A physically motivated truncation of the chains of spin-free T-operators is also made possible by the normal-ordering, and the operational resemblance to single reference coupled-cluster theory allows easy implementation. Our test case is the prediction of the 1s core IP of molecules containing a single light- to medium-heavy nucleus and thus, in addition to demonstrating the orbital relaxation, we have addressed the scalar relativistic effects on the accuracy of the IPs by using a hierarchy of spin-free Hamiltonians in conjunction with our theory. Additionally, the contribution of the spin-free component of the two-electron Gaunt term, not usually taken into consideration, has been estimated at the Self-Consistent Field (ΔSCF) level and is found to become increasingly important and eventually quite prominent for molecules with third period atoms and below. The accuracies of the IPs computed using UGA-OSCC are found to be of the same order as the Coupled Cluster Singles Doubles (ΔCCSD) values while being free from spin contamination. Since the UGA-OSCC uses a common set of orbitals for the ground state and the ion, it obviates the need of two N5 AO to MO transformation in contrast to the ΔCCSD method.