We measured the optical properties of drying wood with the moisture contents ranging from 10% to 200%. By using time-resolved near-infrared spectroscopy, the reduced scattering coefficient μs' and absorption coefficient μa were determined independent of each other, providing information on the chemical and structural changes, respectively, of wood on the nanometer scale. Scattering from dry pores dominated, which allowed us to determine the drying process of large pores during the period of constant drying rate, and the drying process of smaller pores during the period of decreasing drying rate. The surface layer and interior of the wood exhibit different moisture states, which affect the scattering properties of the wood.