We report on an InAs quantum dot (QD) hybrid structure with a top surface QD layer coupled to two buried QD layers that is highly sensitive to surface passivation. After 180 min of passivation, the photoluminescence (PL) peak of the surface QDs shifts from 1545 to 1275 nm while its intensity decreases by one order of magnitude. Time-resolved PL reveals a significant decrease of carrier tunneling between the QD layers because of the surface state modification by chemical treatment. A simple model with rate equations is used to explain the observed optical performance. Our results show that the optical performance of this hybrid structure is very sensitive to the surface environment, making it a potential candidate for sensing applications.