Arbitrary viewpoint video synthesis from multiple uncalibrated cameras

IEEE Trans Syst Man Cybern B Cybern. 2004 Feb;34(1):430-9. doi: 10.1109/tsmcb.2003.817108.

Abstract

We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.

Publication types

  • Evaluation Study
  • Validation Study

MeSH terms

  • Algorithms*
  • Calibration
  • Computer Graphics*
  • Computer Simulation
  • Image Interpretation, Computer-Assisted / methods*
  • Imaging, Three-Dimensional / methods*
  • Pattern Recognition, Automated
  • Photogrammetry / methods*
  • Subtraction Technique
  • User-Computer Interface*
  • Video Recording / instrumentation
  • Video Recording / methods*