Abstract
In the Internet of Things IoT environment, the quality of delivered services essentially relies on several factors, such as the quality of data collected by the numerous numbers of embedded sensors, and the quality of the underlying network. Hence, a fault or anomaly arising from the hardware, software, or network can have devastating consequences regarding the overall quality of the corresponding services. Since that anomalous behaviour can be existed independently due to either an attack or sensor malfunction, develo** methodologies that can detect anomalies and identify their sources seamlessly in real-time is a crucial demand to provide robust and reliable IoT services. This research investigates the potential data quality degradation caused by anomalies through analyzing sensory-related data. The ultimate aim is to utilize unsupervised deep-learning techniques, namely: AE-LSTM, and VAE-LSTM and adopt the edge computing concept that employs edge devices to detect anomalous data, describe, and analyze the effect of such anomalies from the quality provided perspective. This is achieved by introducing a Light-Weight Real-Time Anomaly Detection Framework that comprises two distinct layers: a back layer which includes a deep-learning-based anomaly detection trainer, and a front layer which is an edge device that acts as a Real-time anomaly detector. The evaluated models showed outperformed results compared to the state-of-the-art One-Class Support Vector Machine OCSVM unsupervised learning technique with up to 95% F1 score in detecting anomalies imposed into sensors’ readings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wu, Q., et al.: Cognitive internet of things: a new paradigm beyond connection. IEEE Internet Things J. 1(2), 129–143 (2014)
Lee, J., Davari, H., Singh, J., Pandhare, V.: Industrial Artificial Intelligence for industry 4.0-based manufacturing systems. Manuf. Lett. 18, 20–23 (2018)
Eziama, E., Awin, F., Ahmed, S., Santos-Jaimes, L.M., Pelumi, A., Corral-De-witt, D.: Detection and identification of malicious cyber-attacks in connected and automated vehicles’ real-time sensors. Appl. Sci. 10(21), 1–26 (2020)
Gaddam, A., Wilkin, T., Angelova, M., Gaddam, J.: Detecting sensor faults, anomalies and outliers in the internet of things: a survey on the challenges and solutions (2020)
Castillo, A., Thierer, A.: Economic perspectives projecting the growth and economic impact of the internet of things. SSRN (2015)
Pachauri, G., Sharma, S.: Anomaly detection in medical wireless sensor networks using machine learning algorithms. Procedia Comput. Sci. 70, 325–333 (2015)
Wang, Y., Masoud, N., Khojandi, A.: Real-time sensor anomaly detection and recovery in connected automated vehicle sensors. IEEE Trans. Intell. Transp. Syst. 22(3), 1411–1421 (2021)
Sharma, A.B., Golubchik, L., Govindan, R.: Sensor faults: detection methods and prevalence in real-world datasets. ACM Trans. Sens. Netw. 6(3), 1–39 (2010)
Wang, Q., Lu, Z., Qu, G.: An entropy analysis based intrusion detection system for controller area network in vehicles. In: 31st IEEE International System-on-Chip Conference (SOCC) (2018)
Müter, M., Groll, A., Freiling, F.C.: Anomaly detection for in-vehicle networks using a sensor-based approach. J. Inf. Assur. Secur. 6, 132–140 (2011)
Rajasegarar, S., Leckie, C., Palaniswami, M.: Anomaly detection in wireless sensor networks. IEEE Wirel. Commun. 15(4), 34–40 (2008). https://doi.org/10.1109/MWC.2008.4599219
Hill, D.J., Minsker, B.S., Amir, E.: Real-time Bayesian anomaly detection in streaming environmental data. Water Resour. Res. 46(4) (2009)
Hill, D.J., Minsker, B.S.: Anomaly detection in streaming environmental sensor data: a data-driven modeling approach (2009)
Goyal, N., Dave, M., Verma, A.K.: A novel fault detection and recovery technique for cluster-based underwater wireless sensor networks. Int. J. Commun. Syst. 31(4), e3485 (2017)
Kullaa, J.: Detection, identification, and quantification of sensor fault in a sensor network. Mech. Syst. Signal Process. 40(1), 208–221 (2013). https://doi.org/10.1016/j.ymssp.2013.05.007
**e, M., Han, S., Tian, B., Parvin, S.: Anomaly detection in wireless sensor networks: a survey. J. Netw. Comput. Appl. 34(4), 1302–1325 (2011)
Munir, S., Stankovic, J.A.: FailureSense: detecting sensor failure using electrical appliances in the home. In: Proceedings of the IEEE 11th International Conference on Mobile Ad Hoc and Sensor Systems, MASS 2014, pp. 73–81 (2015)
Zheng, H., Feng, Y., Gao, Y., Tan, J.: A robust predicted performance analysis approach for data-driven product development in the industrial internet of things (2018)
Nesa, N., Ghosh, T., Banerjee, I.: Outlier detection in sensed data using statistical learning models for IoT. In: IEEE Wireless Communications and Networking Conference (WCNC), vol. 2018-April, pp. 1–6 (2018)
Alduais, N.A.M., Abdullah, J., Jamil, A., Audah, L., Alias, R.: Sensor node data validation techniques for realtime IoT/WSN application. In: 2017 14th International Multi-conference on Systems, Signals and Devices (SSD), SSD 2017, vol. 2017-Janua, no. 1, pp. 760–765 (2017)
Javed, N., Wolf, T.: Automated sensor verification using outlier detection in the Internet of things. In: Proceedings of the 32nd International Conference on Distributed Computing Systems Workshops, ICDCSW 2012, pp. 291–296 (2012)
Van Wyk, F., Wang, Y., Khojandi, A., Masoud, N.: Real-time sensor anomaly detection and identification in automated vehicles. IEEE Trans. Intell. Transp. Syst. 21(3), 1264–1276 (2020)
Minovski, D., Ahlund, C., Mitra, K., Cotanis, I.: Anomaly detection for discovering performance degradation in cellular IoT services. In: Proceedings of the Conference on Local Computer Networks, LCN, vol. 2021-Octob, pp. 99–106 (2021)
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., Soderstrom, T.: Detecting spacecraft anomalies using LSTMs and nonparametric dynamic thresholding. In: KDD, vol. 18 (2018)
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., Pei, D.: Robust anomaly detection for multivariate time series through stochastic recurrent neural network, vol. 1485, pp. 2828–2837 (2019)
Park, D., Hoshi, Y., Kemp, C.C.: A multimodal anomaly detector for robot-assisted feeding using an LSTM-based variational autoencoder (2018)
Javed, A.R., Usman, M., Rehman, S.U., Khan, M.U., Haghighi, M.S.: Anomaly detection in automated vehicles using multistage attention-based convolutional neural network. IEEE Trans. Intell. Transp. Syst. 22(7), 4291–4300 (2021)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Understanding LSTM and its diagrams | by Shi Yan | ML Review. https://blog.mlreview.com/understanding-lstm-and-its-diagrams-37e2f46f1714. Accessed 29 Oct 2022
Understanding the 3 most common loss functions for Machine Learning Regression | by George Seif | Towards Data Science. https://towardsdatascience.com/understanding-the-3-most-common-loss-functions-for-machine-learning-regression-23e0ef3e14d3. Accessed 30 Oct 2022
Common Loss Functions in Machine Learning | Built In. https://builtin.com/machine-learning/common-loss-functions. Accessed 30 Oct 2022
Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734 (2014)
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., Shroff, G.: LSTM-based encoder-decoder for multi-sensor anomaly detection (2016)
Ruff, L., et al.: Deep semi-supervised anomaly detection. In: ICLR 2020 (2020)
Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous distributed systems. ar**v Preprint ar**v:1603.04467 (2016)
Kingma, D.P., Lei Ba, J.: ADAM: a method for stochastic optimization (2014)
Teach, learn, and make with the Raspberry Pi Foundation. https://www.raspberrypi.org/. Accessed 07 Nov 2022
TensorFlow Lite. https://www.tensorflow.org/lite/guide. Accessed 07 Dec 2022
IBA-Group-IT/IoT-data-simulator: Generic IoT data simulator. Provides possibility to replay datasets or generates data on fly. Supports various IoT platforms out of the box. https://github.com/IBA-Group-IT/IoT-data-simulator. Accessed 24 Oct 2022
Goh, S.T.: Machine Learning Approaches to Challenging Problems: Interpretable Imbalanced Classification, Interpretable Density Estimation, and Causal Inference. Massachusetts Institute of Technology (2018)
Koyejo, O., Natarajan, N., Ravikumar, P., Dhillon, I.S.: Consistent binary classification with generalized performance metrics. In: Advances in Neural Information Processing Systems, vol. 27 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sanyour, R., Abdullah, M., Abdullah, S. (2023). A Light-Weight Real-Time Anomaly Detection Framework for Edge Computing. In: Daimi, K., Al Sadoon, A. (eds) Proceedings of the 2023 International Conference on Advances in Computing Research (ACR’23). ACR 2023. Lecture Notes in Networks and Systems, vol 700. Springer, Cham. https://doi.org/10.1007/978-3-031-33743-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-33743-7_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-33742-0
Online ISBN: 978-3-031-33743-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)