PhotoRecomposer: Interactive Photo Recomposition by Cropping

IEEE Trans Vis Comput Graph. 2018 Oct;24(10):2728-2742. doi: 10.1109/TVCG.2017.2764895. Epub 2017 Oct 23.

Abstract

We present a visual analysis method for interactively recomposing a large number of photos based on example photos with high-quality composition. The recomposition method is formulated as a matching problem between photos. The key to this formulation is a new metric for accurately measuring the composition distance between photos. We have also developed an earth-mover-distance-based online metric learning algorithm to support the interactive adjustment of the composition distance based on user preferences. To better convey the compositions of a large number of example photos, we have developed a multi-level, example photo layout method to balance multiple factors such as compactness, aspect ratio, composition distance, stability, and overlaps. By introducing an EulerSmooth-based straightening method, the composition of each photos is clearly displayed. The effectiveness and usefulness of the method has been demonstrated by the experimental results, user study, and case studies.

Publication types

  • Research Support, Non-U.S. Gov't