Abstract
Automated machine learning (AutoML) has made life easier for data analysts or scientists by providing quick insights into data by building machine learning (ML) models. AutoML techniques are applied to vast areas from image processing, speech recognition, natural language processing reinforcement learning, and more. However, there is still room for many improvements. AutoML techniques focus only on problems related to predictive modeling, and most of them are designed to work with structured data. AutoML techniques are also time-consuming as they require time to select the appropriate ML pipeline. This paper presents an alternative time-efficient approach for mixed data (both categorical and numerical features obtained from UCI and Kaggle repository) using a data fusion process, which provides high macro average accuracy in less time as compared to AutoML. The AutoML tool considered here is autoscikit-learn (auto-sklearn). This specific library is built in Python using scikit-learn. The implementation of data fusion is also done in Python using scikit-learn. We conclude from the experimental analysis that the pipeline constructed provides better results than the auto-sklearn. This obtained conclusion is supported by a statistical test (Wilcoxon signed ranks test) based on macro average accuracy obtained for both approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
UCI repository https://archive.ics.uci.edu/ml/index.php.
- 2.
Kaggle repository https://www.kaggle.com/datasets.
References
Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13(10), 281–305 (2012). http://jmlr.org/papers/v13/bergstra12a.html
Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)
Escalante, H.J., Montes, M., Sucar, L.E.: Particle swarm model selection. J. Mach. Learn. Res. 10(15), 405–440 (2009). http://jmlr.org/papers/v10/escalante09a.html
Ferri, C., Hernández-Orallo, J., Modroiu, R.: An experimental comparison of performance measures for classification. Pattern Recogn. Lett. 30(1), 27–38 (2009). https://doi.org/10.1016/j.patrec.2008.08.010
Feurer, M., Hutter, F.: Hyperparameter optimization. In: Hutter, F., Kotthoff, L., Vanschoren, J. (eds.) Automated Machine Learning. TSSCML, pp. 3–33. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05318-5_1
Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., Hutter, F.: Efficient and robust automated machine learning. In: Advances in Neural Information Processing Systems, vol. 28, pp. 2962–2970 (2015)
Haq, A., Wilk, S., Abelló, A.: Fusion of clinical data: a case study to predict the type of treatment of bone fractures. Int. J. Appl. Math. Comput. Sci. 29(1), 51–67 (2019). https://doi.org/10.2478/amcs-2019-0004
He, X., Zhao, K., Chu, X.: AutoMl: a survey of the state-of-the-art. Knowl. Based Syst. 212, 106622 (2021)
Hutter, F., Hoos, H., Leyton-Brown, K.: An efficient approach for assessing hyperparameter importance. In: **ng, E.P., Jebara, T. (eds.) Proceedings of the 31st International Conference on Machine Learning. Proceedings of Machine Learning Research, Be**g, China, 22–24 June 2014, vol. 32, pp. 754–762. PMLR (2014). https://proceedings.mlr.press/v32/hutter14.html
Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Coello, C.A.C. (ed.) LION 2011. LNCS, vol. 6683, pp. 507–523. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25566-3_40
Hutter, F., Kotthoff, L., Vanschoren, J. (eds.): Automated Machine Learning: Methods, Systems, Challenges. TSSCML, Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05318-5
John, G.H.: Cross-validated c4.5: using error estimation for automatic parameter selection. Technical report, Stanford University (1994)
Kietz, J.U., Serban, F., Bernstein, A., Fischer, S.: Towards cooperative planning of data mining workows. In: Proceedings of the Third Generation Data Mining Workshop at the 2009 European Conference on Machine Learning (ECML 2009) (2009). https://doi.org/10.5167/uzh-25868
Kim, Y.J., et al.: Scalable and efficient MoE training for multitask multilingual models. CoRR abs/2109.10465 (2021). https://arxiv.org/abs/2109.10465
Lee, H.K.H., Gramacy, R.B., Linkletter, C., Gray, G.A.: Optimization subject to hidden constraints via statistical emulation. Pacific J. Optim. 7(3), 467–478 (2011). https://scholar.google.com/scholar?cluster=6376843206533956665
Madrid, J.G., et al.: Towards automl in the presence of drift: first results. CoRR abs/1907.10772 (2019). http://arxiv.org/abs/1907.10772
Momma, M., Bennett, K.P.: A pattern search method for model selection of support vector regression. In: SDM (2002)
Silva, L.F., Santos, A.A.S., Bravo, R.S., Silva, A.C., Muchaluat-Saade, D.C., Conci, A.: Hybrid analysis for indicating patients with breast cancer using temperature time series. Comput. Methods Programs Biomed. 130, 142–153 (2016). https://doi.org/10.1016/j.cmpb.2016.03.002. https://www.sciencedirect.com/science/article/pii/S0169260715300249
Thornton, C., Hutter, F., Hoos, H.H., Leyton-Brown, K.: Auto-weka: combined selection and hyperparameter optimization of classification algorithms. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 847–855. ACM (2013). https://arxiv.org/pdf/1208.3719
Tiwari, P., Viswanath, S.E., Lee, G., Madabhushi, A.: Multi-modal data fusion schemes for integrated classification of imaging and non-imaging biomedical data. In: IEEE International Symposium on Biomedical Imaging (ISBI), pp. 165–168 (2011)
Wilk, S., Stefanowski, J., Wojciechowski, S., Farion, K.J., Michalowski, W.: Application of preprocessing methods to imbalanced clinical data: an experimental study. In: ITIB (2016)
Yao, Q., et al.: Taking human out of learning applications: a survey on automated machine learning (2019)
Acknowledgement
This research has been funded by the European Commission through the Erasmus Mundus Joint Doctorate - “Information Technologies for Business Intelligence - Doctoral College” (IT4BI-DC).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Haq, A., Wilk, S., Abelló, A. (2022). Comparision of Models Built Using AutoML and Data Fusion. In: Chiusano, S., Cerquitelli, T., Wrembel, R. (eds) Advances in Databases and Information Systems. ADBIS 2022. Lecture Notes in Computer Science, vol 13389. Springer, Cham. https://doi.org/10.1007/978-3-031-15740-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-031-15740-0_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15739-4
Online ISBN: 978-3-031-15740-0
eBook Packages: Computer ScienceComputer Science (R0)