Developing of highly absorbing thin films is essential for exploration of light-matter interaction and polariton-based applications. We demonstrate here layer-by-layer assembled J-aggregate thin films of (DEDOC) cyanine dyes that have high absorption coefficient and controlled thicknesses, leading to adjustable exciton-photon coupling and Rabi splitting exceeding 400 meV at room temperature in all-metal mirror microcavities.