We investigate the scattering attenuation characteristics of the Martian crust and uppermost mantle to understand the structure of the Martian interior. We examine the energy decay of the spectral envelopes for 21 high-quality Martian seismic events from Sol 128 to Sol 500 of InSight operations. We use the model of Dainty et al. (1974b) to approximate the behavior of energy envelopes resulting from scattered wave propagation through a single diffusive layer over an elastic half-space. Using a grid search, we mapped the layer parameters that fit the observed InSight data envelopes. The single diffusive layer model provided better fits to the observed energy envelopes for High Frequency (HF) and Very High Frequency (VF) than for the Low Frequency (LF) and Broadband (BB) events. This result is consistent with the suggested source depths (Giardini et al., 2020) for these families of events and their expected interaction with a shallow scattering layer. The shapes of the observed data envelopes do not show a consistent pattern with event distance, suggesting that the diffusivity and scattering layer thickness is non-uniform in the vicinity of InSight at Mars. Given the consistency in the envelope shapes between HF and VF events across epicentral distances and the tradeoffs between the parameters that control scattering, the dimensions of the scattering layer remain unconstrained but require that scattering strength decreases with depth and that the rate of decay in scattering strength is fastest near the surface. This is generally consistent with the processes that would form scattering structures in planetary lithospheres.