Abstract
To facilitate the interpretation of canonical correlation analysis (CCA) solutions, procedures have been proposed in which CCA solutions are orthogonally rotated to a simple structure. In this paper, we consider oblique rotation for CCA to provide solutions that are much easier to interpret, though only orthogonal rotation is allowed in the existing formulations of CCA. Our task is thus to reformulate CCA so that its solutions have the freedom of oblique rotation. Such a task can be achieved using Yanai’s (Jpn. J. Behaviormetrics 1:46–54, 1974; J. Jpn. Stat. Soc. 11:43–53, 1981) generalized coefficient of determination for the objective function to be maximized in CCA. The resulting solutions are proved to include the existing orthogonal ones as special cases and to be rotated obliquely without affecting the objective function value, where ten Berge’s (Psychometrika 48:519–523, 1983) theorems on suborthonormal matrices are used. A real data example demonstrates that the proposed oblique rotation can provide simple, easily interpreted CCA solutions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Browne, M.W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111–150.
Cliff, N., & Kruss, D.J. (1976). Interpretation of canonical analysis: rotated vs. unrotated solutions. Psychometrika, 41, 35–42.
Darlington, R.B., Weinberg, S.L., & Walberg, H.J. (1973). Canonical variate analysis and related techniques. Review of Educational Research, 43, 433–454.
Gifi, A. (1990). Nonlinear multivariate analysis. Chichester: Wiley.
Greenacre, M.J. (1984). Theory and applications of correspondence analysis. London: Academic Press.
Hendrickson, A.E., & White, P.O. (1964). PROMAX: a quick method for rotation to oblique simple structure. British Journal of Statistical Psychology, 17, 65–70.
Izenmann, A.J. (2008). Modern multivariate statistical techniques. New York: Springer.
Jennrich, R.I. (2002). A simple general method for oblique rotation. Psychometrika, 67, 7–20.
Kaiser, H.F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23, 187–200.
Kerlinger, F.N. (1973). Foundations of behavioral research. New York: Holt.
Lattin, J.M., Carroll, J.D., & Green, P.E. (2003). Analyzing multivariate data. Pacific Grove: Duxbury Press.
Levine, M.S. (1977). Canonical analysis and factor comparison. Beverly Hills: Sage.
Lorenzo-Seva, U., Van de Velden, M., & Kiers, H.A.L. (2009). Oblique rotation in correspondence analysis: a step forward in the search for the simplest interpretation. British Journal of Mathematical & Statistical Psychology, 62, 583–600.
MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In L.M. Le Cam & J. Neyman (Eds.), Proceedings of the fifth Berkeley symposium on mathematical statistics and probability (Vol. 1, pp. 281–298). Berkeley: University of California Press.
Magnus, J.R., & Neudecker, H. (1991). Matrix differential calculus with applications to statistics and econometrics (revised ed.). New York: Wiley.
Mulaik, S.A. (2010). Foundations of factor analysis (2nd ed.). Boca Raton: Chapman & Hall/CRC.
Rao, C.R. (2002). Linear statistical inference and its applications (2nd ed.). New York: Wiley.
Reynolds, T.J., & Jackosfsky, E.F. (1981). Interpreting canonical analysis: the use of orthogonal transformations. Educational and Psychological Measurement, 41, 661–671.
Schepers, J.M. (2006). The utility of canonical correlation analysis, coupled with target rotation, in co** with the effects of differential skewness of variables. Journal of Industrial Psychology, 32, 19–22.
Tanaka, Y., & Tarumi, T. (1995). Windows version of handbook of statistical analysis: multivariate analysis. Tokyo: Kyoritsu Shuppan (in Japanese).
ten Berge, J.M.F. (1983). A generalization of Kristof’s theorem on the trace of certain matrix products. Psychometrika, 48, 519–523.
ten Berge, J.M.F. (1993). Least squares optimization in multivariate analysis. Leiden: DSWO Press.
Thompson, B. (1984). Canonical correlation analysis: uses and interpretation, Newbury Park: Sage.
Thorndike, R.M., & Weiss, D.J. (1973). A study of the stability of canonical correlations and canonical components. Educational and Psychological Measurement, 33, 123–134.
Van de Velden, M., & Kiers, H.A.L. (2005). Rotation in correspondence analysis. Journal of Classification, 22, 251–271.
Wang, L., Wang, X., & Feng, J. (2006). Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition. Pattern Recognition, 39, 456–464.
Yamashita, N. (2012). Canonical correlation analysis formulated as maximizing sum of squared correlations and rotation of structure matrices. Japanese Journal of Behaviormetrics, 39, 1–9 (in Japanese).
Yanai, H. (1974). Unification of various techniques of multivariate analysis by means of generalized coefficient of determination. Japanese Journal of Behaviormetrics, 1, 46–54 (in Japanese).
Yanai, H. (1981). Explicit expression of projectors on canonical variables and distances between centroids of groups. Journal of the Japanese Statistical Society, 11, 43–53.
Yanai, H., Takeuchi, K., & Takane, Y. (2011). Projection matrices, generalized inverse matrices, and singular value decomposition. New York: Springer.
Yates, A. (1987). Multivariate exploratory data analysis: a perspective on exploratory factor analysis. Albany: State University of New York Press.
Zuccon, G., Azzopardi, L., & Van Rijsbergen, C. (2009). Semantic spaces: measuring the distance between different subspaces. In Lecture notes in computer science (Vol. 5494, pp. 225–236).
Acknowledgements
The authors would like to thank the editors, anonymous reviewers, and Mr. Naoto Yamashita for their constructive suggestions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Satomura, H., Adachi, K. Oblique Rotaton in Canonical Correlation Analysis Reformulated as Maximizing the Generalized Coefficient of Determination. Psychometrika 78, 526–537 (2013). https://doi.org/10.1007/s11336-012-9310-4
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11336-012-9310-4