StructureTransfer: A Scene Parsing Framework via Graph Matching for Images and Point Clouds

Date
2016
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Scene parsing is to densely label the pixels in an image with the semantic categories. In this thesis, we present a scene parsing framework which can work on both images and point clouds. To this end, we develop two separate pipelines for images and point clouds. For point clouds, a coarse segmentation is implemented to obtain an initial distribution for the objects. For images, superpixel segmentation is implemented and StructureTransfer is carried out. StructureTransfer is a model to find similar regions across scenes. The two pipelines converge at the inference step. Several novel potentials, representing point cloud constraints and StructureTransfer scores, are introduced into a traditional Markov Random Field (MRF) for the inference. The parsing accuracy of the proposed method is close to state-of-the-art algorithms on images. With the point clouds, the accuracy is significantly enhanced. The proposed framework shows remarkable prospect in real-world applications.
Description
Keywords
Computer Science, Robotics
Citation
Yu, T. (2016). StructureTransfer: A Scene Parsing Framework via Graph Matching for Images and Point Clouds (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca. doi:10.11575/PRISM/27906