We employ three highly sensitive spectrometers: a photoacoustic spectrometer, a photothermal common-path interferometer and a whispering-gallery-resonator-based absorption spectrometer, for a comparative study of measuring the absorption coefficient of nominally transparent undoped, congruently grown lithium niobate for ordinarily and extraordinarily polarized light in the wavelength range from 390 to 3800 nm. The absorption coefficient ranges from below 10(-4) cm(-1) up to 2 cm(-1). Furthermore, we measure the absorption at the Urbach tail as well as the multiphonon edge of the material by a standard grating spectrometer and a Fourier-transform infrared spectrometer, providing for the first time an absorption spectrum of the whole transparency window of lithium niobate. The absorption coefficients obtained by the three highly sensitive and independent methods show good agreement.