Optical coherence tomography (OCT) is a promising tool for detecting micro channels, metal prints, defects and delaminations embedded in alumina and zirconia ceramic layers at hundreds of micrometers beneath surfaces. The effect of surface roughness and scattering of probing radiation within sample on OCT inspection is analyzed from the experimental and simulated OCT images of the ceramic samples with varying surface roughnesses and operating wavelengths. By Monte Carlo simulations of the OCT images in the mid-IR the optimal operating wavelength is found to be 4 µm for the alumina samples and 2 µm for the zirconia samples for achieving sufficient probing depth of about 1 mm. The effects of rough surfaces and dispersion on the detection of the embedded boundaries are discussed. Two types of image artefacts are found in OCT images due to multiple reflections between neighboring boundaries and inhomogeneity of refractive index.