We present the optical optimization of an optomechanical device based on a suspended InP membrane patterned with a 2D near-wavelength grating (NWG) based on a 2D photonic-crystal geometry. We first identify by numerical simulation a set of geometrical parameters providing a reflectivity higher than 99.8% over a 50-nm span. We then study the limitations induced by the finite value of the optical waist and lateral size of the NWG pattern using different numerical approaches. The NWG grating, pierced in a suspended InP 265-nm thick membrane, is used to form a compact microcavity involving the suspended nanomembrane as an end mirror. The resulting cavity has a waist size smaller than 10 μm and a finesse in the 200 range. It is used to probe the Brownian motion of the mechanical modes of the nanomembrane.