Abstract
The key challenge with 3D deformable surface tracking arises from the difficulty in estimating a large number of 3D shape parameters from noisy observations. A recent state-of-the-art approach attacks this problem by formulating it as a Second Order Cone Programming (SOCP) feasibility problem. The main drawback of this solution is the high computational cost. In this paper, we first reformulate the problem into an unconstrained quadratic optimization problem. Instead of handling a large set of complicated SOCP constraints, our new formulation can be solved very efficiently by resolving a set of sparse linear equations. Based on the new framework, a robust iterative method is employed to handle large outliers. We have conducted an extensive set of experiments to evaluate the performance on both synthetic and real-world testbeds, from which the promising results show that the proposed algorithm not only achieves better tracking accuracy, but also executes significantly faster than the previous solution.
Chapter PDF
Similar content being viewed by others
References
Bartoli, A., Zisserman, A.: Direct estimation of non-rigid registration. In: Proc. British Machine Vision Conference, Kingston (September 2004)
Salzmann, M., Pilet, J., Ilic, S., Fua, P.: Surface deformation models for nonrigid 3d shape recovery. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1481–1487 (2007)
Tsap, L.V., Goldgof, D.B., Sarkar, S.: Nonrigid motion analysis based on dynamic refinement of finite element models. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(5), 526–543 (2000)
White, R., Forsyth, D.A.: Combining cues: Shape from shading and texture. In: Proc. Conf. Computer Vision and Pattern Recognition, pp. 1809–1816 (2006)
Zhu, J., Hoi, S.C., Lyu, M.R.: Real-time non-rigid shape recovery via active appearance models for augmented reality. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 186–197. Springer, Heidelberg (2006)
Zhu, J., Lyu, M.R., Huang, T.S.: A fast 2d shape recovery approach by fusing features and appearance. IEEE Trans. Pattern Anal. Mach. Intell (to appear, 2008)
Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding 89(2-3), 114–141 (2003)
**ao, J., Baker, S., Matthews, I., Kanade, T.: Real-time combined 2d+3d active appearance models. In: Proc. Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 535–542 (2004)
Fua, P., Leclerc, Y.: Object-centered surface reconstruction: Combining multi-image stereo and shading. Int’l J. Computer Vision 16(1), 35–56 (1995)
Ilic, S., Fua, P.: Implicit meshes for surface reconstruction. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(2), 328–333 (2006)
Pilet, J., Lepetit, V., Fua, P.: Fast non-rigid surface detection, registration, and realistic augmentation. Int’l J. Computer Vision (2007)
Salzmann, M., Hartley, R., Fua, P.: Convex optimization for deformable surface 3-d tracking. In: Proc. Int’l Conf. Computer Vision (October 2007)
Zhu, J., Lyu, M.R.: Progressive finite newton approach to real-time nonrigid surface detection. In: Proc. Conf. Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Kahl, F.: Multiple view geometry and the l ∞ -norm. In: ICCV, pp. 1002–1009 (2005)
Ke, Q., Kanade, T.: Quasiconvex optimization for robust geometric reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1834–1847 (2007)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3d shape from image streams. In: Conf. Computer Vision and Pattern Recognition, pp. 690–696 (2000)
Salzmann, M., Lepetit, V., Fua, P.: Deformable surface tracking ambiguities. In: Proc. Conf. Computer Vision and Pattern Recognition (2007)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3d morphable model. IEEE Trans. on Pattern Analysis and Machine Intelligence 25(9), 1063–1074 (2003)
Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)
Sim, K., Hartley, R.: Removing outliers using the L ∞ norm. In: Proc. Conf. Computer Vision and Pattern Recognition, pp. 485–494 (2006)
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. Int’l J. Computer Vision 60(2), 91–110 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Electronic Supplementary Material
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, J., Hoi, S.C.H., Xu, Z., Lyu, M.R. (2008). An Effective Approach to 3D Deformable Surface Tracking. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88690-7_57
Download citation
DOI: https://doi.org/10.1007/978-3-540-88690-7_57
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88689-1
Online ISBN: 978-3-540-88690-7
eBook Packages: Computer ScienceComputer Science (R0)