Sim-to-Real Transferable Object Classification Through Touch-Based Continuum Manipulation

  • Conference paper
  • First Online:
Proceedings of the 2018 International Symposium on Experimental Robotics (ISER 2018)

Part of the book series: Springer Proceedings in Advanced Robotics ((SPAR,volume 11))

Included in the following conference series:

Abstract

It is important to investigate object perception for classification or recognition based on touch sensing, especially when robots are operating in darkness or the objects are difficult to capture by vision sensors. In this work, we present a new form of continuum manipulator equipped with sparse touch sensing, validate the effectiveness of automatic generation of the touch-based continuum wraps, and the effectiveness of object classification based on the continuum wraps. Using the indirect object shape information encoded in the robot shape, we demonstrate that a classifier trained from the simulated continuum wraps is transferable to identify the real world objects with real continuum wraps.

H. Mao and J. Santoso—The authors equally contributed to this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 160.49
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 213.99
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
EUR 213.99
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Zhang, M.M., Atanasov, N., Daniilidis, K.: Active end-effector pose selection for tactile object recognition through Monte Carlo tree search. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2017)

    Google Scholar 

  2. Sommer, N., Li, M., Billard, A.: Bimanual compliant tactile exploration for gras** unknown objects. In: International Conference on Robotics and Automation (ICRA). IEEE (2014)

    Google Scholar 

  3. Li, Q., Schürmann, C., Haschke, R., Ritter, H.J.: A control framework for tactile servoing. In: Robotics: Science and Systems (2013)

    Google Scholar 

  4. Yi, Z., Calandra, R., Veiga, F., van Hoof, H., Hermans, T., Zhang, Y., Peters, J.: Active tactile object exploration using Gaussian processes. In: IEEE/RSJ IROS (2016)

    Google Scholar 

  5. Jia, Y.-B., Tian, J.: Surface patch reconstruction from one-dimensional tactile data. IEEE Trans. Autom. Sci. Eng. 7(2), 400–407 (2010)

    Article  Google Scholar 

  6. Mao, H., **ao, J.: Object shape estimation through touch-based continuum manipulation. In: International Symposium of Robotics Research (ISRR) (2017)

    Google Scholar 

  7. Falco, P., Lu, S., Cirillo, A., Natale, C., Pirozzi, S., Lee, D.: Cross-modal visuo-tactile object recognition using robotic active exploration. In: IEEE ICRA (2017)

    Google Scholar 

  8. Li, J., ** in cluttered space. IEEE Trans. Robot. (TRO) 32(3), 707–716 (2016)

    Article  MathSciNet  Google Scholar 

  9. Mao, H., Zhang, M.M., **ao, J., Daniilidis, K.: Shape-based object classification and recognition through continuum manipulation. In: IEEE/RSJ IROS (2017)

    Google Scholar 

  10. Bajo, A., Simaan, N.: Kinematics-based detection and localization of contacts along multisegment continuum robots. IEEE Trans. Robot. 28(2), 291–302 (2012)

    Article  Google Scholar 

  11. Santoso, J., Skorina, E.H., Luo, M., Yan, R., Onal, C.D.: Design and analysis of an origami continuum manipulation module with torsional strength. In: IEEE/RSJ IROS (2017)

    Google Scholar 

Download references

Acknowledgements

This work is supported by NSF grant IIP-1439695, CMMI-1752195.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huitan Mao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mao, H., Santoso, J., Onal, C., **ao, J. (2020). Sim-to-Real Transferable Object Classification Through Touch-Based Continuum Manipulation. In: **ao, J., Kröger, T., Khatib, O. (eds) Proceedings of the 2018 International Symposium on Experimental Robotics. ISER 2018. Springer Proceedings in Advanced Robotics, vol 11. Springer, Cham. https://doi.org/10.1007/978-3-030-33950-0_25

Download citation

Publish with us

Policies and ethics

Navigation