Mitochondria are central organelles in cellular energy metabolism, apoptosis, and aging processes. A signaling network regulating these functions was recently shown to include soluble adenylyl cyclase as a local source of the second messenger cAMP in the mitochondrial matrix. However, a mitochondrial cAMP-degrading phosphodiesterase (PDE) necessary for switching off this cAMP signal has not yet been identified. Here, we describe the identification and characterization of a PDE2A isoform in mitochondria from rodent liver and brain. We find that mitochondrial PDE2A is located in the matrix and that the unique N terminus of PDE2A isoform 2 specifically leads to mitochondrial localization of this isoform. Functional assays show that mitochondrial PDE2A forms a local signaling system with soluble adenylyl cyclase in the matrix, which regulates the activity of the respiratory chain. Our findings complete a cAMP signaling cascade in mitochondria and have implications for understanding the regulation of mitochondrial processes and for their pharmacological modulation.