Active Co-Analysis of a Set of Shapes

ACM Transactions on Graphics(Proceedings of SIGGRAPH ASIA 2012)

Yunhai Wang 1     Shmulik Asafi 2     Oliver van Kaick 3     Hao Zhang3      Daniel Cohen-Or2     Baoquan Chen1    

1Shenzhen VisuCA Key Lab/SIAT
2Tel-Aviv University
3Simon Fraser University
 

Figure 1:   Overview of our active co-analysis: (a) We start with an initial unsupervised co-segmentation of the input set. (b) During active learning, the system automatically suggests constraints which would refine results and the user interactively adds constraints as appropriate. In this example, the user adds a cannot-link constraint (in red) and a must-link constraint (in blue) between segments. (c) The constraints are propagated to the set and the co-segmentation is refined. The process from (b) to (c) is repeated until the desired result is obtained.

 

Abstract

Unsupervised co-analysis of a set of shapes is a difficult problem since the geometry of the shapes alone cannot always fully describe the semantics of the shape parts. In this paper, we propose a semi-supervised learning method where the user actively assists in the co-analysis by iteratively providing inputs that progressively constrain the system. We introduce a novel constrained clustering method based on a spring system which embeds elements to better respect their inter-distances in feature space together with the usergiven set of constraints. We also present an active learning method that suggests to the user where his input is likely to be the most effective in refining the results. We show that each single pair of constraints affects many relations across the set. Thus, the method requires only a sparse set of constraints to quickly converge toward a consistent and error-free semantic labeling of the set.

 

Paper

[PDF]
 

Video

[coming soon...]
 

Slides

[coming soon...]
 

Acknowledgements

The authors would like to thank all the reviewers for their valuable comments. This work is supported in part by grants from NSFC (61202222, 61232011, 61025012), Guangdong Science and Technology Program (2011B050200007), National 863 Program (2011AA010503), Shenzhen Science and Innovation Program (CXB201104220029A, JC201005270329A), NSERC (611370) and the Israel Science Foundation.
 
 

BibTex

@ARTICLE{Active 2012,
  title = {Active Co-Analysis of a Set of Shapes},
  author = {Yunhai Wang and Shmulik Asafi and Oliver van Kaick and Hao Zhang and Daniel Cohen-Or and Baoquan Chen},
  journal = {ACM Transactions on Graphics (Proceedings of SIGGRAPH ASIA 2012)},
  volume = { },
  issue = {4},
  pages = { },
  year = 2012
}