Underground rocks usually have complex pore system with a variety of pore types and a wide range of pore size. The effects of pore structure on elastic wave attenuation cannot be neglected. We investigated the pore structure effects on P-wave scattering attenuation in dry rocks by pore-scale modeling based on the wave theory and the similarity principle. Our modeling results indicate that pore size, pore shape (such as aspect ratio), and pore density are important factors influencing P-wave scattering attenuation in porous rocks, and can explain the variation of scattering attenuation at the same porosity. From the perspective of scattering attenuation, porous rocks can safely suit to the long wavelength assumption when the ratio of wavelength to pore size is larger than 15. Under the long wavelength condition, the scattering attenuation coefficient increases as a power function as the pore density increases, and it increases exponentially with the increase in aspect ratio. For a certain porosity, rocks with smaller aspect ratio and/or larger pore size have stronger scattering attenuation. When the pore aspect ratio is larger than 0.5, the variation of scattering attenuation at the same porosity is dominantly caused by pore size and almost independent of the pore aspect ratio. These results lay a foundation for pore structure inversion from elastic wave responses in porous rocks.