The inhomogeneous broadening of the bi-exciton state in quantum dots, i.e., the inhomogeneous broadening of the upper level of the cascade process, is not only a fundamental problem in quantum dots, but also closely related with the coherent control of this complex system and the quality of the entangled photon pairs, especially the time-bin entangled photon pairs. This inhomogeneous broadening is inherently a two-photon correlated phenomenon. In this work, we construct a genuine Franson-type nonlocal interference process to measure the inhomogeneous broadening of the bi-exciton state. The results show that the inhomogeneous broadening of the bi-exciton state is considerably smaller than that of the exciton state, that is why the entangled photon pairs can be generated by the cascade process in the quantum dot.