3D reconstruction is greatly important for perceptual understanding of applications in robotics, computer graphics, and human-computer interaction. Though tremendous researches have been carried out for geometry reconstruction, there are still many challenges to cope with the large-scale, featureless, and specular surfaces. In this paper, we are motivated to propose a unified framework of geometry reconstruction and fusion for surfaces with the above characteristics. For the geometry reconstruction of specular surfaces, we present a method combining Stereo Phase Measuring Deflectometry (SPMD) with modal wavefront reconstruction to retrieve a reliable geometric surface. For the geometry fusion of largescale featureless surfaces, we put forward an offline calibration approach exploiting the Structure-from-Motion (SfM) to merge point clouds reconstructed from different viewpoints. To evaluate the effectiveness of our method, we build a specific SPMD camera system, design a large-scale calibration board, and set up a test scene with an industrial robot and car body. The experiments show that our method can achieve a good performance in terms of reconstruction accuracy of around 0.02mm and fusion accuracy of around 2mm for a large surface.
Part semantic segmentation based on deep learning provides a new insight for accurate vision understanding of noncooperative satellite as well as for further on-orbit servicing tasks like inspection, repair, and close-proximity robotic manipulation. However, carrying out such researches requires a tremendous amount of data, which is extremely hard and expensive in space. Moreover, the manual annotation for fine-grained tasks like segmentation will cost a lot of labor. Thus, in this paper, we present an efficient method of automated synthetic datasets construction for part-level segmentation of non-cooperative satellite, which is capable of generating thousands of multi-source data (RGB image and point cloud) and the corresponding high-quality annotation. Specifically, the Fibonacci lattice is used for multiple viewpoints sampling of the virtual camera to capture RGB-D images. A trick of segmentation of the customized image in HSV color space is applied to get labels automatically. Furthermore, we employ several data augmentation techniques to expand and diversify the datasets, which improves the generalization of the algorithm. Finally, we carry out the case study using the pointnet++ network based on our generated point cloud data, to validate the feasibility and effectiveness of our method.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.