Tactile Image-to-Image Disentanglement of Contact Geometry from Motion-Induced Shear

Anupam K. Gupta, Laurence Aitchison, Nathan F. Lepora
Proceedings of the 5th Conference on Robot Learning, PMLR 164:14-23, 2022.

Abstract

Robotic touch, particularly when using soft optical tactile sensors, suffers from distortion caused by motion-dependent shear. The manner in which the sensor contacts a stimulus is entangled with the tactile information about the stimulus geometry. In this work, we propose a supervised convolutional deep neural network model that learns to disentangle, in the latent space, the components of sensor deformations caused by contact geometry from those due to sliding-induced shear. The approach is validated by showing a close match between the unsheared images reconstructed from sheared images and their vertical tap (non-sheared) counterparts. In addition, the unsheared tactile images faithfully reconstruct the contact geometry masked in sheared data, and allow robust estimation of the contact pose of use for sliding exploration of various planar shapes. Overall, the contact geometry reconstruction in conjunction with sliding exploration were used for faithful full object reconstruction of various planar shapes. The methods have broad applicability to deep learning models for robots with a shear-sensitive sense of touch.

Cite this Paper

BibTeX
@InProceedings{pmlr-v164-gupta22a, title = {Tactile Image-to-Image Disentanglement of Contact Geometry from Motion-Induced Shear}, author = {Gupta, Anupam K. and Aitchison, Laurence and Lepora, Nathan F.}, booktitle = {Proceedings of the 5th Conference on Robot Learning}, pages = {14--23}, year = {2022}, editor = {Faust, Aleksandra and Hsu, David and Neumann, Gerhard}, volume = {164}, series = {Proceedings of Machine Learning Research}, month = {08--11 Nov}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v164/gupta22a/gupta22a.pdf}, url = {https://proceedings.mlr.press/v164/gupta22a.html}, abstract = {Robotic touch, particularly when using soft optical tactile sensors, suffers from distortion caused by motion-dependent shear. The manner in which the sensor contacts a stimulus is entangled with the tactile information about the stimulus geometry. In this work, we propose a supervised convolutional deep neural network model that learns to disentangle, in the latent space, the components of sensor deformations caused by contact geometry from those due to sliding-induced shear. The approach is validated by showing a close match between the unsheared images reconstructed from sheared images and their vertical tap (non-sheared) counterparts. In addition, the unsheared tactile images faithfully reconstruct the contact geometry masked in sheared data, and allow robust estimation of the contact pose of use for sliding exploration of various planar shapes. Overall, the contact geometry reconstruction in conjunction with sliding exploration were used for faithful full object reconstruction of various planar shapes. The methods have broad applicability to deep learning models for robots with a shear-sensitive sense of touch.} }
Endnote
%0 Conference Paper %T Tactile Image-to-Image Disentanglement of Contact Geometry from Motion-Induced Shear %A Anupam K. Gupta %A Laurence Aitchison %A Nathan F. Lepora %B Proceedings of the 5th Conference on Robot Learning %C Proceedings of Machine Learning Research %D 2022 %E Aleksandra Faust %E David Hsu %E Gerhard Neumann %F pmlr-v164-gupta22a %I PMLR %P 14--23 %U https://proceedings.mlr.press/v164/gupta22a.html %V 164 %X Robotic touch, particularly when using soft optical tactile sensors, suffers from distortion caused by motion-dependent shear. The manner in which the sensor contacts a stimulus is entangled with the tactile information about the stimulus geometry. In this work, we propose a supervised convolutional deep neural network model that learns to disentangle, in the latent space, the components of sensor deformations caused by contact geometry from those due to sliding-induced shear. The approach is validated by showing a close match between the unsheared images reconstructed from sheared images and their vertical tap (non-sheared) counterparts. In addition, the unsheared tactile images faithfully reconstruct the contact geometry masked in sheared data, and allow robust estimation of the contact pose of use for sliding exploration of various planar shapes. Overall, the contact geometry reconstruction in conjunction with sliding exploration were used for faithful full object reconstruction of various planar shapes. The methods have broad applicability to deep learning models for robots with a shear-sensitive sense of touch.
APA
Gupta, A.K., Aitchison, L. & Lepora, N.F.. (2022). Tactile Image-to-Image Disentanglement of Contact Geometry from Motion-Induced Shear. Proceedings of the 5th Conference on Robot Learning, in Proceedings of Machine Learning Research 164:14-23 Available from https://proceedings.mlr.press/v164/gupta22a.html.

Related Material