Abstract
A key limitation of all existing algorithms for shape and motion from image sequences under orthographic, weak perspective and para-perspective projection is that they require the calibration parameters of the camera. We present in this paper a new approach that allows the shape and motion to be computed from image sequences without having to know the calibration parameters. This approach is derived with the affine camera model, introduced by Mundy and Zisserman (1992), which is a more general class of projections including orthographic, weak perspective and para-perspective projection models. The concept of self-calibration, introduced by Maybank and Faugeras (1992) for the perspective camera and by Hartley (1994) for the rotating camera, is then applied for the affine camera.
This paper introduces the 3 intrinsic parameters that the affine camera can have at most. The intrinsic parameters of the affine camera are closely related to the usual intrinsic parameters of the pin-hole perspective camera, but are different in the general case. Based on the invariance of the intrinsic parameters, methods of self-calibration of the affine camera are proposed. It is shown that with at least four views, an affine camera may be self-calibrated up to a scaling factor, leading to Euclidean (similarity) shape réconstruction up to a global scaling factor. Another consequence of the introduction of intrinsic and extrinsic parameters of the affine camera is that all existing algorithms using calibrated affine cameras can be assembled into the same framework and some of them can be easily extented to a batch solution.
Experimental results are presented and compared with other methods using calibrated affine cameras.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aloimonos, J.Y. 1992. Perspective approximation.Image and Vision Computing, 8(3): 179–192.
Boufama, B., Weinshall, D., and Werman, M. 1994. Shape from motion algorithms: A comparative analysis of scaled orthography and perspective. In J.O.Eklundh, (ed.),Proceedings of the 3rd European Conference on Computer Vision, Stockholm, Sweden, Springer-Verlag, pp. 199–204.
Du, F. and Brady, M. 1993. Self-calibration of the intrinsic parameters of cameras for active vision systems. In Proceedings of the Conference on Computer Vision and Pattern Recognition, New York, USA, pp. 477–482, Los Alamitos, California, IEEE Computer Society Press.
Faugeras, O. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In G.Sandini, (ed.),Proceedings of the 2nd European Conference on Computer Vision, Santa Margherita Ligure, Italy, Springer-Verlag, pp. 563–578.
Faugeras, O. 1993.Three-Dimensional Computer Vision—A Geometric Viewpoint. Artificial intelligence. M.I.T. Press, Cambridge, MA.
Faugeras, O.D., Luong, Q.T., and Maybank, S.J. 1992. Camera Self-Calibration: Theory and Experiments. In G.Sandini, (ed.),Proceedings of the 2nd European Conference on Computer Vision, Santa Margherita Ligure, Italy, Springer-Verlag, pp. 321–334.
Golub, G.H. and VanLoan, C.F. 1989.Matrix Computation. The Johns Hopkins University Press, Baltimore.
Hartley, R., Gupta, R., and Chang, T. 1992. Stereo from uncalibrated cameras. In Proceedings of the Conference on Computer Vision and Pattern Recognition, Urbana-Champaign, Illinois, USA, pp. 761–764.
Hartley, R.I. 1992. Estimation of relative camera positions for uncalibrated cameras. In G.Sandini, (ed.),Proceedings of the 2nd European Conference on Computer Vision, Santa Margherita Ligure, Italy, Springer-Verlag, pp. 579–587.
Hartley, R.I. 1994. Self-calibration from multiple views with a rotating camera. In Proceedings of the 3rd European Conference on Computer Vision, Stockholm, Sweden, Springer-Verlag, pp. 471–478.
Horaud, R., Christy, S., and Dornaika, F. 1994. Object Pose: the Link between Weak Perspective, Para Perspective, and Full Perspective. Technical report, Inria.
Hu, X. and Ahuja, N. 1994. Mirror uncertainty and uniqueness conditions for determining shape and motion from orthographic projection.International Journal of Computer Vision, 13(3):295–309.
Koenderink, J.J. and VanDoorn, A.J. 1989. Affine structure from motion. Technical report, Utrecht University, Utrecht, The Netherlands.
Lee, C.H. and Huang, T. 1990. Finding point correspondences and determining motion of a rigid object from two weak perspective views.Computer Vision, Graphics and Image Processing, 52:309–327.
Luong, Q.T. 1992.Matrice Fondamentale et Autocalibration en Vision par Ordinateur. Thèse de doctorat, Université de Paris-Sud, Orsay, France.
Maybank, S.J. and Faugeras, O.D. 1992. A theory of self calibration of a moving camera.International Journal of Computer Vision, 8(2):123–151.
McLauchlan, P.F., Reid, I.D., and Murray, D.W. 1994. Recursive affine structure and motion from image sequences. In J.O.Eklundh, (ed.),Proceedings of the 3rd European Conference on Computer Vision, Stockholm, Sweden, Springer-Verlag, pp. 217–224.
Mohr, R., Quan, L., and Veillon, F. 1995. Relative 3D reconstruction using multiple uncalibrated images.The International Journal of Robotics Research. To appear.
Mundy, J.L. and Zisserman, A. editors. 1992.Geometric Invariance in Computer Vision. MIT Press, Cambridge, Massachusetts, USA.
Otha, Y., Maenobu, K., and Sakai, T. 1981. Obtaining surface orientation from texels under perspective projection. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 746–751.
Poelman, C.J. and Kanade, T. 1994. A paraperspective factorization method for shape and motion recovery. In J.O. Eklundh, (ed.),Proceedings of the 3rd European Conference on Computer Vision, Stockholm, Sweden, pp. 97–108.
Press, W.H., Flannery, B.P., Teukolsky, S.A., and Vetterling, W.T. 1988.Numerical Recipes in C. Cambridge University Press.
Quan, L. 1995. Invariants of six points and projective reconstruction from three uncalibrated images.IEEE Transactions on PAMI, 17(1):34–46.
Quan, L. and Mohr, R. 1991. Affine shape representation from motion through reference points.Journal of Mathematical Imaging and Vision. 1:145–151, 1992. Also in IEEE Workshop on Visual Motion, New Jersey, pp. 249–254.
Shapiro, L.S., Zisserman, A., and Brady, M. 1994. Motion from point matches using affine epipolar geometry.International Journal of Computer Vision.
Tomasi, C. and Kanade, T. 1992. Shape and motion from image streams under orthography: A factorization method.International Journal of Computer Vision. 9(2):137–154.
Tsai, R.Y. 1987. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses.IEEE Journal of Robotics and Automation, 3(4):323–344.
Ullman, S. 1979.The Interpretation of Visual Motion. The MIT Press.
Ullman, S. and Basri, R. 1991. Recognition by linear combinations of models.IEEE Transactions on PAMI. 13(10):992–1006.
Weinshall, D. 1993. Model-based invariants for 3-D vision.International Journal of Computer Vision. 10(1):27–42.
Weinshall, D. and Tomasi, C. 1993. Linear and incremental acquisition of invariant shape models from image sequences. In Proceedings of the 4th International Conference on Computer Vision, Berlin, Germany, IEEE.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Quan, L. Self-calibration of an affine camera from multiple views. Int J Comput Vision 19, 93–105 (1996). https://doi.org/10.1007/BF00131149
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00131149