Autoscanning for coupled scene reconstruction and proactive object analysis
Kai Xu, Hui Huang, Yifei Shi, Hao Li, Pinxin Long, Jianong Caichen, Wei Sun, Baoquan Chen
In ACM Transactions on Graphics (TOG), 34(6), November 2015.
Abstract: Detailed scanning of indoor scenes is tedious for humans. We propose autonomous scene scanning by a robot to relieve humans from such a laborious task. In an autonomous setting, detailed scene acquisition is inevitably coupled with scene analysis at the required level of detail. We develop a framework for object-level scene reconstruction coupled with object-centric scene analysis. As a result, the autoscanning and reconstruction will be object-aware, guided by the object analysis. The analysis is, in turn, gradually improved with progressively increased object-wise data fidelity. In realizing such a framework, we drive the robot to execute an iterative analyze-and-validate algorithm which interleaves between object analysis and guided validations. The object analysis incorporates online learning into a robust graph-cut based segmentation framework, achieving a global update of object-level segmentation based on the knowledge gained from robot-operated local validation. Based on the current analysis, the robot performs proactive validation over the scene with physical push and scan refinement, aiming at reducing the uncertainty of both object-level segmentation and object-wise reconstruction. We propose a joint entropy to measure such uncertainty based on segmentation confidence and reconstruction quality, and formulate the selection of validation actions as a maximum information gain problem. The output of our system is a reconstructed scene with both object extraction and object-wise geometry fidelity.
Article URL: http://doi.acm.org/10.1145/2816795.2818075
BibTeX format:
@article{10.1145-2816795.2818075,
  author = {Kai Xu and Hui Huang and Yifei Shi and Hao Li and Pinxin Long and Jianong Caichen and Wei Sun and Baoquan Chen},
  title = {Autoscanning for coupled scene reconstruction and proactive object analysis},
  journal = {ACM Transactions on Graphics (TOG)},
  volume = {34},
  number = {6},
  articleno = {177},
  month = nov,
  year = {2015},
}
Search for more articles by Kai Xu.
Search for more articles by Hui Huang.
Search for more articles by Yifei Shi.
Search for more articles by Hao Li.
Search for more articles by Pinxin Long.
Search for more articles by Jianong Caichen.
Search for more articles by Wei Sun.
Search for more articles by Baoquan Chen.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."