Robust 3D reconstruction in noisy environments

August 2021

Robust 3D reconstruction in noisy environments

Authors:

Shirsendu Sukanta Halder

Abstract:

Automated inspection in industrial manufacturing can minimize the total production cost of a part. Current inspection solutions often involve measuring a part manually, which interrupts the machining process. We present two non-contact real-time systems which integrate visual inspection in-line with CNC (computer numerical control) machines and ensure dimensional model generation of parts with high accuracy. We first present a camera-projector scanning system that uses photometric stereo and structured light scanning to reconstruct the shape of objects in the presence of specular chip-like noise and high-speed object revolution. We obtain reconstruction accuracies down to 0.5 mm for objects with complex reflectance on a representative CNC lathe. For rotationally symmetric objects, we also propose a novel shape from silhouette system which uses principles from light transport theory to efficiently image transmissive paths through a scattering medium. The system enables in-line and highly accurate geometric reconstructions down to 60 μm on CNC lathe machines in the presence of scattering fluid and specular metallic shavings. Both systems are compact and cost-effective alternatives to the current use of CMMs (coordinate measuring machines) for manual inspection of machined parts.

Notes:

@mastersthesis{Halder-2021-129178,
author = {Shirsendu Sukanta Halder},
title = {Robust 3D reconstruction in noisy environments},
year = {2021},
month = {August},
school = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-21-40},
keywords = {Computational imaging, computer vision, automated inspection},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.