Abstract
In this book chapter, we provide a selective review of recent advances in tensor analysis and tensor modeling in statistics and machine learning. We then provide examples in health data science applications.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Acar, E., Bro, R., & Smilde, A. K. (2015). Data fusion in metabolomics using coupled matrix and tensor factorizations. Proceedings of the IEEE, 103(9), 1602–1620.
Acar, E., Kolda, T. G., & Dunlavy, D. M. (2011). All-at-once optimization for coupled matrix and tensor factorizations. In Proceedings of mining and learning with graphs (MLG’11). IEEE.
Acar, E., Levin-Schwartz, Y., Calhoun, V. D., & Adali, T. (2017). Tensor-based fusion of EEG and fMRI to understand neurological changes in schizophrenia. In 2017 IEEE international symposium on circuits and systems (ISCAS) (pp. 1–4). IEEE.
Acar, E., Papalexakis, E. E., Gürdeniz, G., Rasmussen, M. A., Lawaetz, A. J., Nilsson, M., & Bro, R. (2014). Structure-revealing data fusion. BMC Bioinformatics, 15(1), 1–17.
Acar, E., Rasmussen, M. A., Savorani, F., Næs, T., & Bro, R. (2013). Understanding data fusion within the framework of coupled matrix and tensor factorizations. Chemometrics and Intelligent Laboratory Systems, 129, 53–63.
Allen, G. (2012). Sparse higher-order principal components analysis. In Artificial intelligence and statistics (pp. 27–36). PMLR.
Anandkumar, A., Ge, R., Hsu, D., & Kakade, S. M. (2014). A tensor approach to learning mixed membership community models. Journal of Machine Learning Research, 15(1), 2239–2312.
Bahargam, S., & Papalexakis, E. E. (2018). Constrained coupled matrix-tensor factorization and its application in pattern and topic detection. In 2018 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM) (pp. 91–94). IEEE.
Baranzini, S. E., Mousavi, P., Rio, J., Caillier, S. J., Stillman, A., Villoslada, P., Wyatt, M. M., Comabella, M., Greller, L. D., Somogyi, R., et al. (2005). Transcription-based prediction of response to IFN\(\beta \) using supervised computational methods. PLoS Biology, 3(1), e2.
Bi, X., Qu, A., & Shen, X. (2018). Multilayer tensor factorization with applications to recommender systems.
Braak, H., & Braak, E. (1991). Neuropathological stageing of Alzheimer-related changes. Acta Neuropathologica, 82(4), 239–259.
Cai, B., Zhang, J., & Sun, W. W. (2021). Jointly modeling and clustering tensors in high dimensions. ar**v preprint ar**v:2104.07773.
Cao, X., Wei, X., Han, Y., & Lin, D. (2015). Robust face clustering via tensor decomposition. IEEE Transactions on Cybernetics, 45(11), 2546–2557.
Cao, X., Wei, X., Han, Y., Yang, Y., & Lin, D. (2013). Robust tensor clustering with non-greedy maximization. In Twenty-Third international joint conference on artificial intelligence. Citeseer.
Carroll, J. D., & Chang, J.-J. (1970). Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition. Psychometrika, 35(3), 283–319.
Chen, H., Raskutti, G., & Yuan, M. (2019). Non-convex projected gradient descent for generalized low-rank tensor regression. The Journal of Machine Learning Research, 20(1), 172–208.
Chen, J., **e, J., & Li, H. (2011). A penalized likelihood approach for bivariate conditional normal models for dynamic co-expression analysis. Biometrics, 67(1), 299–308.
Chi, E. C., Gaines, B. R., Sun, W. W., Zhou, H., & Yang, J. (2020). Provable convex co-clustering of tensors. The Journal of Machine Learning Research, 21(1), 8792–8849.
Cook, R. D. (1998). Regression Graphics: Ideas for Studying Regressions Through Graphics (Vol. 318). Wiley.
Cook, R. D., & Li, B. (2002). Dimension reduction for conditional mean in regression. The Annals of Statistics, 30(2), 455–474.
Cook, R. D., Li, B., & Chiaromonte, F. (2010). Envelope models for parsimonious and efficient multivariate linear regression. Statistica Sinica, 20(3), 927–1010.
Cook, R. D., & Weisberg, S. (1991). Discussion of sliced inverse regression for dimension reduction. Journal of the American Statistical Association, 86(414), 328–332.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20, 273–297.
De Lathauwer, L., De Moor, B., & Vandewalle, J. (2000a). A multilinear singular value decomposition. SIAM Journal on Matrix Analysis and Applications, 21(4), 1253–1278.
De Lathauwer, L., De Moor, B., & Vandewalle, J. (2000b). On the best rank-1 and rank-(r1, r2,\(\ldots \), rn) approximation of higher-order tensors. SIAM Journal on Matrix Analysis and Applications, 21(4), 1324–1342.
De Martino, F., De Borst, A. W., Valente, G., Goebel, R., & Formisano, E. (2011). Predicting EEG single trial responses with simultaneous fMRI and relevance vector machine regression. Neuroimage, 56(2), 826–836.
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1), 1–22.
Deng, K., & Zhang, X. (2022). Tensor envelope mixture model for simultaneous clustering and multiway dimension reduction. Biometrics, 78(3), 1067–1079.
Ermiş, B., Acar, E., & Cemgil, A. T. (2015). Link prediction in heterogeneous data via generalized coupled tensor factorization. Data Mining and Knowledge Discovery, 29, 203–236.
Gahrooei, M. R., Yan, H., Paynabar, K., & Shi, J. (2021). Multiple tensor-on-tensor regression: An approach for modeling processes with heterogeneous sources of data. Technometrics, 63(2), 147–159.
Gao, X., Shen, W., Zhang, L., Hu, J., Fortin, N. J., Frostig, R. D., & Ombao, H. (2021). Regularized matrix data clustering and its application to image analysis. Biometrics, 77(3), 890–902.
Han, R., Willett, R., & Zhang, A. R. (2022). An optimal statistical and computational framework for generalized tensor estimation. The Annals of Statistics, 50(1), 1–29.
Hao, B., Wang, B., Wang, P., Zhang, J., Yang, J., & Sun, W. W. (2021). Sparse tensor additive regression. The Journal of Machine Learning Research, 22(1), 2989–3031.
Hao, B., Zhang, A. R., & Cheng, G. (2020). Sparse and low-rank tensor estimation via cubic sketchings. In International conference on artificial intelligence and statistics (pp. 1319–1330). PMLR.
He, Z., Guo, J. L., McBride, J. D., Narasimhan, S., Kim, H., Changolkar, L., Zhang, B., Gathagan, R. J., Yue, C., & Dengler, C. (2018). Amyloid-\(\beta \) plaques enhance Alzheimer’s brain tau-seeded pathologies by facilitating neuritic plaque tau aggregation. Nature Medicine, 24(1), 29–38.
Hillar, C. J., & Lim, L.-H. (2013). Most tensor problems are NP-hard. Journal of the ACM (JACM), 60(6), 1–39.
Hoff, P. D. (2015). Multilinear tensor regression for longitudinal relational data. The Annals of Applied Statistics, 9(3), 1169.
Hotelling, H. (1936). Relations between two sets of variates. Biometrika, 28(3–4), 321–377.
Ibriga, H. S., & Sun, W. W. (2022). Covariate-assisted sparse tensor completion. Journal of the American Statistical Association, 0(0), 1–15.
Imaizumi, M., & Hayashi, K. (2016). Doubly decomposing nonparametric tensor regression. In International conference on machine learning (pp. 727–736). PMLR.
Jack Jr, C. R., Barkhof, F., Bernstein, M. A., Cantillon, M., Cole, P. E., DeCarli, C., Dubois, B., Duchesne, S., Fox, N. C., & Frisoni, G. B. (2011). Steps to standardization and validation of hippocampal volumetry as a biomarker in clinical trials and diagnostic criterion for Alzheimer’s disease. Alzheimer’s & Dementia, 7(4), 474–485.
Jansen, M., White, T. P., Mullinger, K. J., Liddle, E. B., Gowland, P. A., Francis, S. T., Bowtell, R., & Liddle, P. F. (2012). Motion-related artefacts in EEG predict neuronally plausible patterns of activation in fMRI data. Neuroimage, 59(1), 261–270.
Jegelka, S., Sra, S., & Banerjee, A. (2009). Approximation algorithms for tensor clustering. In Algorithmic Learning Theory: 20th International Conference, ALT 2009, Porto, Portugal, October 3–5, 2009. Proceedings 20 (pp. 368–383). Springer.
Jeon, B., Jeon, I., Sael, L., & Kang, U. (2016). SCouT: Scalable coupled matrix-tensor factorization-algorithm and discoveries. In 2016 IEEE 32nd International Conference on Data Engineering (ICDE) (pp. 811–822). IEEE.
Kanatsoulis, C. I., Fu, X., Sidiropoulos, N. D., & Ma, W.-K. (2018). Hyperspectral super-resolution: A coupled tensor factorization approach. IEEE Transactions on Signal Processing, 66(24), 6503–6517.
Kolda, T. G., & Bader, B. W. (2009). Tensor decompositions and applications. SIAM Review, 51(3), 455–500.
Kong, D., An, B., Zhang, J., & Zhu, H. (2019). L2RM: Low-rank linear regression models for high-dimensional matrix responses. Journal of the American Statistical Association, 115(529), 403–424.
Lai, Z., Xu, Y., Yang, J., Tang, J., & Zhang, D. (2013). Sparse tensor discriminant analysis. IEEE Transactions on Image Processing, 22(10), 3904–3915.
Lee, H. Y., Reisi Gahrooei, M., Liu, H., & Pacella, M. (2023). Robust tensor-on-tensor regression for multidimensional data modeling. In IISE Transactions (pp. 1–11).
Li, B., Kim, M. K., & Altman, N. (2010). On dimension folding of matrix- or array-valued statistical objects. The Annals of Statistics, 38(2), 1094–1121.
Li, B., & Wang, S. (2007). On directional regression for dimension reduction. Journal of the American Statistical Association, 102(479), 997–1008.
Li, K.-C. (1991). Sliced inverse regression for dimension reduction. Journal of the American Statistical Association, 86(414), 316–327.
Li, K.-C. (2002). Genome-wide coexpression dynamics: theory and application. Proceedings of the National Academy of Sciences, 99(26), 16875–16880.
Li, K.-C., Liu, C.-T., Sun, W., Yuan, S., & Yu, T. (2004). A system for enhancing genome-wide coexpression dynamics study. Proceedings of the National Academy of Sciences, 101(44), 15561–15566.
Li, L., Zeng, J., & Zhang, X. (2022). Generalized liquid association analysis for multimodal data integration. Journal of the American Statistical Association, 0(0), 1–13.
Li, L., & Zhang, X. (2017). Parsimonious tensor response regression. Journal of the American Statistical Association, 112(519), 1131–1146.
Li, S., Dian, R., Fang, L., & Bioucas-Dias, J. M. (2018a). Fusing hyperspectral and multispectral images via coupled sparse tensor factorization. IEEE Transactions on Image Processing, 27(8), 4118–4130.
Li, X., Xu, D., Zhou, H., & Li, L. (2018b). Tucker tensor regression and neuroimaging analysis. Statistics in Biosciences, 10, 520–545.
Li, Z., Suk, H.-I., Shen, D., & Li, L. (2016). Sparse multi-response tensor regression for Alzheimer’s disease study with multivariate clinical assessments. IEEE Transactions on Medical Imaging, 35(8), 1927–1936.
Lock, E. F. (2018). Tensor-on-tensor regression. Journal of Computational and Graphical Statistics, 27(3), 638–647.
Lyu, T., Lock, E. F., & Eberly, L. E. (2017). Discriminating sample groups with multi-way data. Biostatistics, 18(3), 434–450.
Mai, Q., Zhang, X., Pan, Y., & Deng, K. (2022). A doubly enhanced EM algorithm for model-based tensor clustering. Journal of the American Statistical Association, 117(540), 2120–2134.
Malik, O. A., & Becker, S. (2018). Low-rank tucker decomposition of large tensors using TensorSketch. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18 (pp. 10117–10127), Red Hook: Curran Associates Inc.
Manceur, A. M., & Dutilleul, P. (2013). Maximum likelihood estimation for the tensor normal distribution: Algorithm, minimum sample size, and empirical bias and dispersion. Journal of Computational and Applied Mathematics, 239, 37–49.
Marron, J. S., Todd, M. J., & Ahn, J. (2007). Distance-weighted discrimination. Journal of the American Statistical Association, 102(480), 1267–1271.
Mirzaei, G., & Adeli, H. (2018). Segmentation and clustering in brain MRI imaging. Reviews in the Neurosciences, 30(1), 31–44.
Miwakeichi, F., Martınez-Montes, E., Valdés-Sosa, P. A., Nishiyama, N., Mizuhara, H., & Yamaguchi, Y. (2004). Decomposing EEG data into space–time–frequency components using parallel factor analysis. NeuroImage, 22(3), 1035–1045.
Ollila, E., & Kim, H.-J. (2022). Robust tensor regression with applications in imaging. In 2022 30th European signal processing conference (EUSIPCO) (pp. 887–891). IEEE.
Pan, Y., Mai, Q., & Zhang, X. (2019). Covariate-adjusted tensor classification in high dimensions. Journal of the American Statistical Association, 114(527), 1305–1319.
Rabusseau, G., & Kadri, H. (2016). Low-rank regression with tensor responses. Advances in Neural Information Processing Systems, 29, 1867–1875.
Raskutti, G., Yuan, M., & Chen, H. (2019). Convex regularization for high-dimensional multiresponse tensor regression. The Annals of Statistics, 47(3), 1554–1584.
Richard, E., & Montanari, A. (2014). A statistical model for tensor PCA. Advances in Neural Information Processing Systems, 27, 2897–2905.
Roohi, S. F., Zonoobi, D., Kassim, A. A., & Jaremko, J. L. (2017). Multi-dimensional low rank plus sparse decomposition for reconstruction of under-sampled dynamic MRI. Pattern Recognition, 63, 667–679.
Schenker, C., Cohen, J. E., & Acar, E. (2021). An optimization framework for regularized linearly coupled matrix-tensor factorization. In 2020 28th European Signal Processing Conference (EUSIPCO) (pp. 985–989). IEEE.
Sheng, W., & Yin, X. (2016). Sufficient dimension reduction via distance covariance. Journal of Computational and Graphical Statistics, 25(1), 91–104.
Sheng, W., & Yuan, Q. (2020). Sufficient dimension folding in regression via distance covariance for matrix-valued predictors. Statistical Analysis and Data Mining: The ASA Data Science Journal, 13(1), 71–82.
Sun, W. W., & Li, L. (2017). STORE: sparse tensor response regression and neuroimaging analysis. The Journal of Machine Learning Research, 18(1), 4908–4944.
Sun, W. W., & Li, L. (2019). Dynamic tensor clustering. Journal of the American Statistical Association, 114(528), 1894–1907.
Sun, W. W., Lu, J., Liu, H., & Cheng, G. (2017). Provable sparse tensor decomposition. Journal of the Royal Statistical Society. Series B (Statistical Methodology), 79(3), 899–916.
Suzuki, T., Kanagawa, H., Kobayashi, H., Shimizu, N., & Tagami, Y. (2016). Minimax optimal alternating minimization for kernel nonparametric tensor learning. Advances in Neural Information Processing Systems, 29, 3783–3791.
Tao, D., Li, X., Wu, X., & Maybank, S. J. (2007). General tensor discriminant analysis and Gabor features for gait recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(10), 1700–1715.
Tran, D. T., Gabbouj, M., & Iosifidis, A. (2017). Multilinear class-specific discriminant analysis. Pattern Recognition Letters, 100, 131–136.
Tucker, L. R. (1966). Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3), 279–311.
Viroli, C. (2011). Model based clustering for three-way data structures. Bayesian Analysis, 6(4), 573–602.
Vogel, J. W., Iturria-Medina, Y., Strandberg, O. T., Smith, R., Levitis, E., Evans, A. C., & Hansson, O. (2020). Spread of pathological tau proteins through communicating neurons in human Alzheimer’s disease. Nature Communications, 11(1), 2612.
Wang, M., & Li, L. (2020). Learning from binary multiway data: Probabilistic tensor decomposition and its statistical optimality. The Journal of Machine Learning Research, 21(1), 6146–6183.
Wang, N., Zhang, X., & Li, B. (2022). Likelihood-based dimension folding on tensor data. Statistica Sinica, 32, 2405–2429.
Wang, X., Zhu, H., & Initiative, A. D. N. (2017). Generalized scalar-on-image regression models via total variation. Journal of the American Statistical Association, 112(519), 1156–1168.
**a, Y., Tong, H., Li, W. K., & Zhu, L.-X. (2002). An adaptive estimation of dimension reduction space. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(3), 363–410.
Xue, Y., & Yin, X. (2014). Sufficient dimension folding for regression mean function. Journal of Computational and Graphical Statistics, 23(4), 1028–1043.
Yan, H., Paynabar, K., & Pacella, M. (2019). Structured point cloud data analysis via regularized tensor regression for process modeling and optimization. Technometrics, 61(3), 385–395.
Ye, J., Janardan, R., & Li, Q. (2004). Two-dimensional linear discriminant analysis. Advances in Neural Information Processing Systems, 17, 1569–1576.
Yin, X., & Cook, R. D. (2002). Dimension reduction for the conditional kth moment in regression. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(2), 159–175.
Zhang, A. (2019). Cross: Efficient low-rank tensor completion. The Annals of Statistics, 47(2), 936–964.
Zhang, A., & Han, R. (2019). Optimal sparse singular value decomposition for high-dimensional high-order data. Journal of the American Statistical Association, 114(528), 1708–1725.
Zhang, A., & **a, D. (2018). Tensor SVD: Statistical and computational limits. IEEE Transactions on Information Theory, 64(11), 7311–7338.
Zhang, X., & Li, L. (2017). Tensor envelope partial least-squares regression. Technometrics, 59(4), 426–436.
Zhao, M., Reisi Gahrooei, M., & Gaw, N. (2023). Robust coupled tensor decomposition and feature extraction for multimodal medical data. IISE Transactions on Healthcare Systems Engineering, 13(2), 117–131.
Zhong, W., & Suslick, K. S. (2015). Matrix discriminant analysis with application to colorimetric sensor array data. Technometrics, 57(4), 524–534.
Zhou, H., Li, L., & Zhu, H. (2013). Tensor regression with applications in neuroimaging data analysis. Journal of the American Statistical Association, 108(502), 540–552.
Zhou, J., Sun, W. W., Zhang, J., & Li, L. (2021). Partially observed dynamic tensor response regression. Journal of the American Statistical Association, 0(0), 1–16.
Zhu, X., & Hao, R. (2016). Context-aware location recommendations with tensor factorization. In 2016 IEEE/CIC International Conference on Communications in China (ICCC) (pp. 1–6). IEEE.
Zou, H., Hastie, T., & Tibshirani, R. (2006). Sparse principal component analysis. Journal of Computational and Graphical Statistics, 15(2), 265–286.
Acknowledgements
Zeng’s research was partly supported by grant 12301365 from the National Natural Science Foundation of China and grant WK2040000075 from the Fundamental Research Funds for the Central Universities.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Zeng, J., Zhang, X. (2024). Tensor and Multimodal Data Analysis. In: Gaw, N., Pardalos, P.M., Gahrooei, M.R. (eds) Multimodal and Tensor Data Analytics for Industrial Systems Improvement. Springer Optimization and Its Applications, vol 211. Springer, Cham. https://doi.org/10.1007/978-3-031-53092-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-53092-0_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53091-3
Online ISBN: 978-3-031-53092-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)