An 81-year-old man, with chronic renal failure due to chronic glomerulonephritis on maintenance hemodialysis (HD) for 4.5 years, was admitted to our hospital because of rapidly developing hyperglycemia and hypertension. He had been under good control on HD with no history of hyperglycemia. One month prior to admission he felt thirsty and generally fatigued, but did not inform medical staff of his symptoms. We diagnosed him as suffering from autoimmune pancreatitis (AIMP) associated with secondary diabetes mellitus, according to the typical feature of AIMP on endoscopic retrograde cholangiopancreatography and an elevated level of serum immunoglobulin G4 (IgG4). He was treated with insulin and a corticosteroid, following which, the diffuse narrowing of the main pancreatic duct improved and his serum IgG4 level reduced. AIMP is a rare but important complication in HD patients that requires prompt diagnosis and treatment; we are therefore reporting on a unique complication in a chronic HD patient.