Autoimmune pancreatitis is a rare benign inflammatory disease, treated with steroids. It consists of two clinical and histological distinct types, type 1 and type 2. Type 1 is part of an IgG4-related multiorgan disease, while type 2 is pancreas-specific. We here present a case of each type illustrating the difficult diagnostic process and how it can be misinterpreted as pancreatic carcinoma or cholangiocarcinoma. Though autoimmune pancreatitis is rare it should be considered as a differential diagnosis to pancreatic cancer.