The fabrication and characterization of a surface plasmon resonance based pH sensor using coatings of silver, ITO (In2O3:SnO2), aluminium and smart hydrogel layers over an unclad core of an optical fiber have been reported. The silver, aluminium and ITO layers were coated using a thermal evaporation technique, while the hydrogel layer was prepared using a dip-coating method. The sensor works on the principle of detecting changes in the refractive index of the hydrogel layer due to its swelling and shrinkage caused by changes in the pH of the fluid surrounding the hydrogel layer. The sensor utilizes a wavelength interrogation technique and operates in a particular window of low and high pH values. Increasing the pH value of the fluid causes swelling of the hydrogel layer, which decreases its refractive index and results in a shift of the resonance wavelength towards blue in the transmitted spectra. The thicknesses of the ITO and aluminium layers have been optimized to achieve the best performance of the sensor. The ITO layer increases the sensitivity while the aluminium layer increases the detection accuracy of the sensor. The proposed sensor possesses maximum sensitivity in comparison to the sensors reported in the literature. A negligible effect of ambient temperature in the range 25 °C to 45 °C on the performance of the sensor has been observed. The additional advantages of the sensor are short response time, low cost, probe miniaturization, probe re-usability and the capability of remote sensing.