Abstract
In intelligent machining, tool condition monitoring (TCM) is crucial to improving tool efficiency and machining accuracy, which requires the real-time analysis and feature extraction of multivariate time series signals collected by multiple sensors. However, multivariate time series are ultra-high-dimensional and difficult to perform representation learning directly, requiring sampling and typical feature extraction. The existing deep feature extractors based on Sequential sampling, Random sampling, or Window sampling, are poor at capturing the critical information from the huge amount of time series data, and ignore the temporal associations, so the actual results are not satisfactory in terms of prediction accuracy and efficiency. Therefore, we propose an appending-inspired multivariate time series association fusion method for TCM tasks: after the necessary denoising, we capture typical time-domain, frequency-domain, and time-frequency-domain features of multivariate time series based on the proposed appending-inspired feature capturer to fully consider the temporal associations, and employ the ACNNs (Attention-based Convolutional Neural Networks) to extract and fuse the multivariate time series features for real-time TCM tasks. The experimental results on NASA and PHM2010 datasets show that our method can real-time and effectively monitor the tool condition and accurately predict the tool wear state.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data that support the findings of this study are openly available, and we have posted the links in the footnotes of Sect. 4.1.
References
Ambadekar, P. K., & Choudhari, C. M. (2020). CNN based tool monitoring system to predict life of cutting tool. SN Applied Sciences, 2, 1–11. https://doi.org/10.1007/s42452-020-2598-2
Ambhore, N., Kamble, D., Chinchanikar, S., & Wayal, V. (2015). Tool condition monitoring system: A review. Materials Today: Proceedings, 2(4–5), 3419–3428. https://doi.org/10.1016/j.matpr.2015.07.317
Beeraka, S. M., Kumar, A., Sameer, M., Ghosh, S., & Gupta, B. (2022). Accuracy enhancement of epileptic seizure detection: A deep learning approach with hardware realization of STFT. Circuits Systems and Signal Processing, 41, 461–484. https://doi.org/10.1007/s00034-021-01789-4
Cao, X. C., Chen, B. Q., Yao, B., & He, W. P. (2019). Combining translation-invariant wavelet frames and convolutional neural network for intelligent tool wear state identification. Computers in Industry, 106, 71–84. https://doi.org/10.1016/j.compind.2018.12.018
Casusol, A. J., Zegarra, F. C., Vargas-Machuca, J., & Coronado, A. M. (2021). Optimal window size for the extraction of features for tool wear estimation. In the 28th international conference on electronics, electrical engineering and computing (pp. 1–4). https://doi.org/10.1109/intercon52678.2021.9532759
Fang, N., Pai, P. S., & Mosquea, S. (2010). The effect of built-up edge on the cutting vibrations in machining 2024-T351 aluminum alloy. The International Journal of Advanced Manufacturing Technology, 49, 63–71. https://doi.org/10.1007/s00170-009-2394-z
Fu, Y., Zhang, Y., Qiao, H., Li, D., Zhou, H., & Leopold, J. (2015). Analysis of feature extracting ability for cutting state monitoring using deep belief networks. In the 15th CIRP conference on modelling of machining operations (pp. 29–34). https://doi.org/10.1016/j.procir.2015.03.016
Gao, C., Bintao, S., Wu, H., Peng, M., & Zhou, Y. (2021). New tool wear estimation method of the milling process based on multisensor blind source separation. Mathematical Problems in Engineering, https://doi.org/10.1155/2021/9985870
Goyal, D., & Pabla, B. S. (2016). The vibration monitoring methods and signal processing techniques for structural health monitoring: A review. Archives of Computational Methods in Engineering, 23, 585–594. https://doi.org/10.1007/s11831-015-9145-0
Huang, K., You, M. Y., Ye, Y. X., Jiang, B., & Lu, A. N. (2020). Direction of arrival based on the multioutput least squares support vector regression model. Mathematical Problems in Engineering, https://doi.org/10.1155/2020/8601376
Huang, N. (2014). Introduction to the Hilbert-Huang transform and its related mathematical problems. In Hilbert–Huang Transform and Its Applications (pp. 1–26). https://doi.org/10.1142/9789814508247_0001
Huang, N., Shen, Z., Long, S. R., Wu, M. L., Shih, H., Zheng, Q. N., Yen, N. C., Tung, C. C., Liu, H. H., Tung, C. C., & Liu, H. (1998). The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society: Mathematical, Physical & Engineering Sciences, 454(1971), 903–995. https://doi.org/10.1098/rspa.1998.0193
Kothuru, A., Nooka, S. P., & Liu, R. (2019). Application of deep visualization in CNN-based tool condition monitoring for end milling. Procedia Manufacturing, 34, 995–1004. https://doi.org/10.1016/j.promfg.2019.06.096
Kuntoğlu, M., & Sağlam, H. (2019). Investigation of progressive tool wear for determining of optimized machining parameters in turning. Measurement, 140, 427–436. https://doi.org/10.1016/j.measurement.2019.04.022
Li, D. Y., Yuan, D. F., Liang, D. J., Di, Z. J., Zhang, M. Q., Cao, F., **n, M. M., Jiang, M. Y., & Jiang, M. Y. (2021). Tool fault diagnosis based on improved multiscale network and feature fusion. In 2021 IEEE International Conference on Prognostics and Health Management (pp. 1–6). IEEE. https://doi.org/10.1109/icphm51084.2021.9486491
Li, Y., Liu, C., Hua, J., Gao, J., & Maropoulos, P. (2019). A novel method for accurately monitoring and predicting tool wear under varying cutting conditions based on meta-learning. CIRP Annals, 68(1), 487–490. https://doi.org/10.1016/j.cirp.2019.03.010
Li, Z., Liu, X., Incecik, A., Gupta, M. K., Królczyk, G. M., & Gardoni, P. (2022). A novel ensemble deep learning model for cutting tool wear monitoring using audio sensors. Journal of Manufacturing Processes, 79, 233–249. https://doi.org/10.1016/j.jmapro.2022.04.066
Liu, M. K., Tseng, Y. H., & Tran, M. Q. (2019). Tool wear monitoring and prediction based on sound signal. The International Journal of Advanced Manufacturing Technology, 103, 3361–3373. https://doi.org/10.1007/s00170-019-03686-2
Liu, X., Liu, S., Li, X., Zhang, B., Yue, C., & Liang, S. Y. (2021). Intelligent tool wear monitoring based on parallel residual and stacked bidirectional long short-term memory network. Journal of Manufacturing Systems, 60, 608–619. https://doi.org/10.1016/j.jmsy.2021.06.006
Liu, X., Zhang, B., Li, X., Liu, S., Yue, C., & Liang, S. Y. (2023). An approach for tool wear prediction using customized DenseNet and GRU integrated model based on multi-sensor feature fusion. Journal of Intelligent Manufacturing, 34(2), 885–902. https://doi.org/10.1007/s10845-022-01954-9
Malekian, M., Park, S. S., & Jun, M. B. (2009). Tool wear monitoring of micro-milling operations. Journal of Materials Processing Technology, 209(10), 4903–4914. https://doi.org/10.1016/j.jmatprotec.2009.01.013
Ou, J., Li, H., Huang, G., & Zhou, Q. (2020). A novel order analysis and stacked sparse auto-encoder feature learning method for milling tool wear condition monitoring. Sensors (Basel, Switzerland), 20(10), 2878. https://doi.org/10.3390/s20102878
Serin, G., Sener, B., Ozbayoglu, A. M., & Unver, H. O. (2020). Review of tool condition monitoring in machining and opportunities for deep learning. The International Journal of Advanced Manufacturing Technology, 109, 953–974. https://doi.org/10.1007/s00170-020-05449-w
Shen, B., Gui, Y., Chen, B., Lin, Z., Liu, Q., & Liu, Q. (2020). Application of spindle power signals in tool condition monitoring based on HHT algorithm. The International Journal of Advanced Manufacturing Technology, 106, 1385–1395. https://doi.org/10.1007/s00170-019-04684-0
Sun, H., Zhang, J., Mo, R., & Zhang, X. (2020). In-process tool condition forecasting based on a deep learning method. Robotics and Computer-Integrated Manufacturing, 64, 101924. https://doi.org/10.1016/j.rcim.2019.101924
Teti, R., Jemielniak, K., O’Donnell, G., & Dornfeld, D. (2010). Advanced monitoring of machining operations. CIRP Annals-Manufacturing Technology, 59(2), 717–739. https://doi.org/10.1016/j.cirp.2010.05.010
Wang, L., Mehrabi, M. G., & Kannatey-Asibu Jr, E. (2002). Hidden Markov model-based tool wear monitoring in turning. Journal of Manufacturing Science and Engineering, 124(3), 651–658. https://doi.org/10.1115/1.1475320
Wang, L., Yang, J., Zhang, Y., Zhao, X., & **e, Y. (2018). Tool wear condition recognition based on SDAE. China Mechanical Engineering, 29(17), 2038. https://doi.org/10.3969/j.issn.1004-132x.2018.17.004
Xu, H., Zhang, C., Hong, G. S., Zhou, J., Hong, J., & Woon, K. S. (2018, July). Gated recurrent units based neural network for tool condition monitoring. In 2018 international joint conference on neural networks (pp. 1–7). https://doi.org/10.1109/ijcnn.2018.8489354
Xu, W., Miao, H., Zhao, Z., Liu, J., Sun, C., & Yan, R. (2021). Multi-scale convolutional gated recurrent unit networks for tool wear prediction in smart manufacturing. Chinese Journal of Mechanical Engineering, 34(1), 53. https://doi.org/10.1186/s10033-021-00565-4
Yang, Y., Guo, Y., Huang, Z., Chen, N., Li, L., Jiang, Y., & He, N. (2019). Research on the milling tool wear and life prediction by establishing an integrated predictive model. Measurement: Journal of the International Measurement Confederation, 145, 178–189. https://doi.org/10.1016/j.measurement.2019.05.009
Yu, W., Mechefske, C. K., & Kim, I. Y. (2018). Cutting tool wear estimation using a genetic algorithm based long short-term memory neural network. In ASME 2018 international design engineering technical conferences and computers and information in engineering conference (pp. 1–6). https://doi.org/10.1115/detc2018-85253
Zhao, R., Wang, J., Yan, R., & Mao, K. (2016). Machine health monitoring with LSTM networks. In the 10th international conference on sensing technology (pp. 1–6). https://doi.org/10.1109/icsENSt.2016.7796266
Zhao, R., Wang, D., Yan, R., Mao, K., Shen, F., & Wang, J. (2017). Machine health monitoring using local feature-based gated recurrent unit networks. IEEE Transactions on Industrial Electronics, 65(2), 1539–1548. https://doi.org/10.1109/tie.2017.2733438
Zhong, R. Y., Xu, X., Klotz, E., & Newman, S. T. (2017). Intelligent manufacturing in the context of industry 4.0: A review. Engineering, 3(5), 616–630. https://doi.org/10.1016/J.ENG.2017.05.015
Zhou, Y., & Xue, W. (2018). Review of tool condition monitoring methods in milling processes. The International Journal of Advanced Manufacturing Technology, 96, 2509–2523. https://doi.org/10.1007/s00170-018-1768-5
Zhu, K. P., Li, G. C., & Zhang, Y. (2020). Big data oriented smart tool condition monitoring system. IEEE Transactions on Industrial Informatics, 16(6), 4007–4016. https://doi.org/10.1109/tii.2019.2957107
Funding
This work was supported by the Chunhui Project Foundation of the Education Department of China (HZKY20220291), and Natural Science Foundation of Heilongjiang Province (LH2022F034).
Author information
Authors and Affiliations
Contributions
LX: conceptualization, methodology, investigation, resources, supervision, visualization, project administration, funding acquisition, writing—review & editing. WW: conceptualization, methodology, validation, investigation, software, data curation, writing—original draft. JC: software, methodology, validation, formal analysis, writing—review & editing. XW: software, resources, supervision, project administration.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s Note
Springer nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
**, L., Wang, W., Chen, J. et al. Appending-inspired multivariate time series association fusion for tool condition monitoring. J Intell Manuf (2023). https://doi.org/10.1007/s10845-023-02202-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10845-023-02202-4