Recent progress of our group on medical image analysis research and its application to image guided medicine is presented. Firstly, we describe preoperative image analysis for organ modeling and automated surgical planning. Secondly, newly developed calibration technologies for intraoperative guidance of endoscopic surgery are presented.