Protein-based fluorescent and functional probes are widely used for real-time visualization, purification, and regulation of a variety of biological molecules. The protein-based probes can generally be targeted into subcellular compartments of eukaryotic cells by a particular short peptide sequence. Little is known, however, about the sequence that targets probes into the mitochondrial intermembrane space (IMS). To identify the IMS-targeting sequence, we developed a simple genetic screening method to discriminate the proteins localized in the IMS from those in the mitochondrial matrix, thereby revealing the minimum requisite sequence for the IMS targeting. An IMS-localized protein, Smac/DIABLO, was randomly mutated, and the mitochondrial localization of each mutant was analyzed. We found that the four residues of Ala-Val-Pro-Ile are required for IMS localization, and a sequence of these four residues fused with matrix-targeting signals is sufficient for targeting the Smac/DIABLO into the IMS. The sequence was shown to readily direct three dissimilar proteins of interest to the IMS, which will open avenues to elucidating the functions of the IMS in live cells.