Estimation of 3D Information of multiple objects in a monocular Image

Takuma Hirose; Noriko Yata; Yoshitsugu Manabe

doi:10.1117/12.2591017

13 March 2021 Estimation of 3D Information of multiple objects in a monocular Image

Takuma Hirose, Noriko Yata, Yoshitsugu Manabe

Proceedings Volume 11766, International Workshop on Advanced Imaging Technology (IWAIT) 2021; 117661Q (2021) https://doi.org/10.1117/12.2591017
Event: International Workshop on Advanced Imaging Technology 2021 (IWAIT 2021), 2021, Online Only

Abstract

This paper proposes a method for estimating 3D information, such as shape, orientation, size, and position of objects in a monocular image, and reproduce scenes in 3D point clouds using Convolutional Neural Network (CNN). This study proposes a network that combines depth estimation, object detection, and point cloud estimation to estimate 3D information of objects. The proposed network requires networks for object detection and segmentation, and a point cloud estimation for object shape estimation. The point cloud estimation network is robust to the reproduction of the object's surface and can deal with unknown objects through a semantic understanding of the object’s shape. In addition to these networks, we combine a depth estimation network for estimating the depth of the entire scene and the distance between the camera and object. In this paper, we consider the point cloud estimation network. We estimate the point clouds for real objects in the images of the dataset and evaluate the output point clouds.

Citation Download Citation

Takuma Hirose, Noriko Yata, and Yoshitsugu Manabe "Estimation of 3D Information of multiple objects in a monocular Image", Proc. SPIE 11766, International Workshop on Advanced Imaging Technology (IWAIT) 2021, 117661Q (13 March 2021); https://doi.org/10.1117/12.2591017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available