Visual Servoing

  • Living reference work entry
  • First Online:
Computer Vision

Synonyms

Vision-based control; Visual feedback

Definition

Visual servoing refers to the use of visual data as input of real-time closed-loop control schemes for controlling the motion of a dynamic system, a robot typically. It can be defined as sensor-based control from a vision sensor and relies on techniques from image processing, computer vision, and control theory.

Related concepts

Background

Basically, visual servoing consists in using the data provided by one or several cameras so that a dynamic system achieves a task specified by a set of visual constraints [12, 3]. Such systems are usually robot arms or mobile robots, but can also be virtual robots, or even a virtual camera. A large variety of positioning tasks, or target tracking tasks, can be considered by controlling from one to all the degrees of freedom (DoF) of the system. Whatever the sensor configuration,...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Bakthavatchalam M, Tahri O, Chaumette F (2018) A direct dense visual servoing approach using photometric moments. IEEE Trans Robot 34(5):1226–1239

    Article  Google Scholar 

  2. Chaumette F (2004) Image moments: a general and useful set of features for visual servoing. IEEE Trans Robot 20(4):713–723s

    Google Scholar 

  3. Chaumette F, Hutchinson S, Corke P (2016) Visual servoing. In: Handbook of robotics, Chap 34, 2nd edn. Springer, pp 841–866

    Google Scholar 

  4. Collewet C, Marchand E (2011) Photometric visual servoing. IEEE Trans Robot 27(4):828–834

    Article  Google Scholar 

  5. Corke P, Good M (1996) Dynamic effects in visual closed-loop systems. IEEE Trans Robot Autom 12(5):671–683

    Article  Google Scholar 

  6. Crombez N, Mouaddib EM, Caron G, Chaumette F (2019) Visual servoing with photometric Gaussian mixtures as dense features. IEEE Trans Robot 35(1):49–63

    Article  Google Scholar 

  7. Dame A, Marchand E (2011) Mutual information-based visual servoing. IEEE Trans Robot 27(5): 958–969

    Article  Google Scholar 

  8. De Luca A, Oriolo G, Robuffo Giordano P (2008) Feature depth observation for image-based visual servoing: theory and experiments, Int J Robot Res 38(4):422–450, 27(10):1093–1116

    Article  Google Scholar 

  9. Duflot LA, Reisenhofer R, Tamadazte B, Andreff N, Krupa A (2019) Wavelet and shearlet-baed image representations for visual servoing, Int J Robot Res 38(4):422–450

    Article  Google Scholar 

  10. Espiau B, Chaumette F, Rives P (1992) A new approach to visual servoing in robotics. IEEE Trans Robot Autom 8(3):313–326

    Article  Google Scholar 

  11. Hamel T, Mahony R (2002) Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach. IEEE Trans Robot Autom 18(2):187–198

    Article  Google Scholar 

  12. Hutchinson S, Hager G, Corke P (1996) A tutorial on visual servo control. IEEE Trans Robot Autom 12(5):651–670

    Article  Google Scholar 

  13. Malis E, Chaumette F (2000) 2-1/2D visual servoing with respect to unknown objects through a new estimation scheme of camera displacement. Int J Comput Vis 37(1):79–97

    Google Scholar 

  14. Mariottini GL, Oriolo G, Prattichizo D (2007) Image-based visual servoing for nonholonomic mobile robots using epipolar geometry. IEEE Trans Robot 23(1):87–100

    Article  Google Scholar 

  15. Mezouar Y, Chaumette F (2002) Path planning for robust image-based control. IEEE Trans Robot 22(10):781–804

    Google Scholar 

  16. Nayar S, Nene S, Murase H (1996) Subspace methods for robot vision. IEEE Trans Robot Autom 12(5):750–758

    Article  Google Scholar 

  17. Nelson B, Khosla P (1995) Strategies for increasing the tracking region of an eye-in-hand system by singularity and joint limit avoidance. Int J Robot Res 14(3):225–269

    Article  Google Scholar 

  18. Silveira G, Malis E (2012) Direct visual servoing: vision-based estimation and control using only nonmetric information. IEEE Trans Robot 28(4): 974–980

    Article  Google Scholar 

  19. Weiss L, Sanderson A, Neuman C (1987) Dynamic sensor-based control of robots with visual feedback. IEEE J Robot Autom 3(5):404–417

    Article  Google Scholar 

  20. Wilson W, Hulls C, Bell G (1996) Relative end-effector control using Cartesian position-based visual servoing. IEEE Trans Robot Autom 12(5):684–696

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to François Chaumette .

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Chaumette, F. (2020). Visual Servoing. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_281-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_281-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Navigation