Structural biological materials have developed heterogeneous and hierarchical architectures that are responsible for the outstanding performance to provide protection against environmental threats including static and dynamic loading. Inspired by this observation, this research aims to develop new material and structural concepts for broadband vibration mitigation. The proposed composite materials possess a two-layered heterogeneous architecture where both layers consist of high-volume platelet-shape reinforcements and low-volume matrix, similar to the well-known "brick and mortar" microstructure of biological composites. Using finite element method, we numerically demonstrated that broadband wave attenuation zones can be achieved by tailoring the geometric features of the heterogeneous architecture. We reveal that the resulting broadband attenuation zones are gained by directly superimposing the attenuation zones in each constituent layer. This mechanism is further confirmed by the investigation into the phonon dispersion relation of each layer. Importantly, the broadband wave attenuation capability will be maintained when the mineral platelet orientation is locally manipulated, yet a contrast between the mineral platelet concentrations of the two constituent layers is essential. The findings of this work will provide new opportunities to design heterogeneous composites for broadband vibration mitigation and impact resistance under mechanically challenging environmental conditions.