We report a case of acinar cell carcinoma of the pancreas with colon involvement that was difficult to distinguish from primary colon cancer. A 60-year-old man was admitted with a 1-month history of diarrhea. Contrast-enhanced computed tomography (CT) revealed a large tumor (10.6 × 11.6 cm) at the splenic flexure of the colon. Colonoscopy showed completely round ulcerative lesions, and biopsy revealed poorly differentiated adenocarcinoma. Left hemicolectomy, resection of the jejunum and pancreas body and tail, and splenectomy were performed based on a diagnosis of descending colon cancer (cT4N0M0, stage IIB), and surgery was considered to be curative. Diagnosis was subsequently confirmed as moderately differentiated acinar cell carcinoma of the pancreas by immunohistochemical staining (pT3N0M0, stage IIA). Multiple liver metastases with portal thrombosis were found 8 weeks postoperatively. Despite combination chemotherapy with oral S-1 and gemcitabine, the patient died of hepatic failure with no effect of chemotherapy 14 weeks postoperatively. Correct diagnosis was difficult to determine preoperatively from the clinical, CT, and colonoscopy findings. Moreover, the disease was extremely aggressive even after curative resection. Physicians should consider pancreatic cancer in the differential diagnosis of similar cases.