Saffman-Taylor instability exhibits a stepwise unstable morphology from a stable interface to viscous fingering, eventually leading to tip splitting. The nonlinear dynamics of the destabilized interface depends on various flow properties. However, the physicochemical mechanism that determines the transition point of the flow state is unclear. We studied the interfacial instability transition in miscible displacement from a thermodynamic perspective by calculating the momentum transport and entropy production. Using numerical analysis based on Darcy's law coupled with the convection-diffusion equation, the observed flux-dependent flow state transitions were attributed to the selection of the flow state with a higher entropy production.