FlowWeb: Joint Image Set Alignment by Weaving Consistent, Pixel-Wise Correspondences
| Title | FlowWeb: Joint Image Set Alignment by Weaving Consistent, Pixel-Wise Correspondences |
| Publication Type | Conference Paper |
| Year of Publication | 2015 |
| Authors | Zhou, T., Lee Y. Jae, Yu S. X., & Efros A. A. |
| Other Numbers | 3764 |
| Abstract | Given a set of poorly aligned images of the same visual concept without any annotations, we propose an algorithm to jointly bring them into pixel-wise correspondence by estimating a FlowWeb representation of the image set. FlowWeb is a fully-connected correspondence flow graph with each node representing an image, and each edge representing the correspondence flow field between a pair of images, i.e. a vector field indicating how each pixel in one image can find a corresponding pixel in the other image. Correspondence flow is related to optical flow but allows for correspondences between visually dissimilar regions if there is evidence they correspond transitively on the graph. Our algorithm starts by initializing all edges of this complete graph with an off-the-shelf, pairwise flow method. We then iteratively update the graph to force it to be more self-consistent. Once the algorithm converges, dense, globally-consistent correspondences can be read off the graph. Our results suggest that FlowWeb improves alignment accuracy over previous pairwise as well as joint alignment methods. |
| Acknowledgment | This work is partially sponsored by the Office of Naval Research through MURI N000141010934. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors or originators and do not necessarily reflect the views of ONR or of the U.S. Government. |
| URL | https://www.icsi.berkeley.edu/pubs/vision/flowweb15.pdf |
| Bibliographic Notes | Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015), Boston, Massachusetts |
| Abbreviated Authors | T. Zhou, Y. J. Lee, S. X. Yu, and A. A. Efros |
| ICSI Research Group | Vision |
| ICSI Publication Type | Article in conference proceedings |