We propose an adaptive way to improve noise reduction by local geometric projection. From the neighborhood of each candidate point in phase space, we identify the best subspace that the point will be orthogonally projected to. The signal subspace is formed by the most significant eigendirections of the neighborhood, while the less significant ones define the noise subspace. We provide a simple criterion to separate the most significant eigendirections from the less significant ones. This criterion is based on the maximum logarithmic difference between the neighborhood eigendirection lengths, and the assumption that there is at least one eigendirection that corresponds to the noise subspace. In this way, we take into account the special characteristics of each neighborhood and introduce a more successful noise reduction technique. Results are presented for a chaotic time series of the Henon map and Ikeda map, as well as on the Nasdaq Composite index.