An in-line fiber quasi-Michelson interferometer (IFQMI) working on reflection is proposed and experimentally demonstrated. The sensing head is fabricated by splicing a section of polarization-maintaining photonic crystal fiber (PM-PCF) with a lead-in single mode fiber (SMF). Some cladding modes are excited into the PM-PCF via the mismatch-core splicing interface between PM-PCF and SMF. Besides, two orthogonal polarized-modes are formed due to the inherent multiholes cladding structure of the PM-PCF. A well-defined interference pattern is obtained as the result of cladding-orthogonal modes interference. The IFQMI with 20 cm long PM-PCF is proposed for strain and torsion measurements. A strain sensitivity of -1.3 pm/με and a torsion sensitivity of -19.17 pm/deg are obtained, respectively. The proposed device with 10 cm long PM-PCF exhibits a considered temperature sensitivity of 9.9 pm/°C. The IFQMI has a compact structure and small size, making it a good candidate for multiparameter measurements.