The native states of proteins exist as an ensemble of conformationally similar microstates. The fluctuations among different microstates are of great importance for the functions and structural stability of proteins. Here, we demonstrate that single molecule atomic force microscopy (AFM) can be used to directly probe the existence of multiple folded microstates. We used the AFM to repeatedly stretch and relax a recombinant tenascin fragment TNfnALL to allow the fibronectin type III (FnIII) domains to undergo repeated unfolding/refolding cycles. In addition to the native state, we discovered that some FnIII domains can refold from the unfolded state into a previously unrecognized microstate, N* state. This novel state is conformationally similar to the native state, but mechanically less stable. The native state unfolds at approximately 120 pN, while the N* state unfolds at approximately 50 pN. These two distinct populations of microstates constitute the ensemble of the folded states for some FnIII domains. An unfolded FnIII domain can fold into either one of the two microstates via two distinct folding routes. These results reveal the dynamic and heterogeneous picture of the folded ensemble for some FnIII domains of tenascin, which may carry important implications for the mechanical functions of tenascins in vivo.