Shape Tracking of Flexible Morphing Matters From Depth Images
View/ Open
Published version
Embargoed until: 5555-01-01
Reason: Version Not Permitted
Embargoed until: 5555-01-01
Reason: Version Not Permitted
Volume
21
Pagination
8234 - 8244
Publisher
DOI
10.1109/JSEN.2020.3039172
Journal
IEEE SENSORS JOURNAL
Issue
ISSN
1530-437X
Metadata
Show full item recordAbstract
The development and use of soft or flexible structural matters across various research domains have drastically increased in recent decades. Its flexible, compliant nature and interactive safety have made it a preferred candidate compared to its rigid bodied counterparts. However, the lack of robust soft robot detection and localization techniques has constrained its feedback control system, limiting its application. This paper proposes a novel depth sensor-based detection and tracking algorithm adaptive to shape morphing robots. The detection algorithm first employs optimal iterative threshold segmentation on the depth image to remove background and detect occlusions. Blob detection and polygon approximation using Fourier descriptor techniques are then utilized to detect and extract the contours of the shape morphing soft robots. Finally, using the pixel coordinates obtained from the detection algorithm, transformation is applied from the pixel coordinate system to the world coordinate system on the depth image to achieve motion tracking in 3D space. Qualitative and quantitative assessments prove that the detection algorithm is robust and accurate in tracking shape morphing soft robots.