The effects of X-doping (X = S, Se, Te and Po) on the structural, electronic and optical properties of hexagonal CuAlO2 were studied using first-principles density functional theory. The calculated results showed the obtained lattice constants to increase with increasing atomic number, and the X-doping to be energetically more favorable under Al-rich conditions. The calculated electronic properties showed decreased bandgaps with increasing atomic number, which was due to the better covalent hybridizations after sulfuration doping. The enhanced covalency was further confirmed by calculating the Mulliken atomic populations and bond populations. The density of states indicated the increase of the contribution to antibonding from the X-p states to be a benefit for p-type conductivity. Moreover, the X-doping induced a red shift of the absorption edge.