Abstract
Multi-access edge computing (MEC) is a technology that enables devices with limited processing capabilities to handle computationally intensive tasks efficiently. The challenge with MEC is how to schedule multiple tasks rationally and efficiently, mainly when each device generates several tasks. A critical aspect of task scheduling is considering the spatial relationships between devices in the network to reduce long-term losses. To address these challenges, this article proposes a deep reinforcement learning (DRL)-based Mayfly Taylor optimization algorithm (MTOA) that uses graph attention neural networks (GATs). The algorithm creates a planning agent for each end device that collects timing-related characteristics of activities and makes decisions and predictions using a recurrent gated unit and a graph representation agent (GRU). The GRU contains possible spatial elements from the scenario and incorporates them into the decision-making process. A novel approach, the Mayfly Taylor optimization algorithm (MTOA), for addressing the challenges in Multi-access Edge Computing (MEC) task scheduling. The key innovation lies in the integration of deep reinforcement learning (DRL) with graph attention neural networks (GATs) to create an effective scheduling strategy. The proposed algorithm outperforms several baseline methods by exploiting the spatial positional relationships between devices. It significantly reduces average latency, bandwidth, and dropout rates and increases in link usage efficiency. Overall, the proposed approach provides a solution to the task-scheduling problem in the MEC scenario that considers separable and time-sensitive activities while benefiting from the spatial relationships between devices.
Similar content being viewed by others
Data Availability
The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.
References
Li, Y., Li, J., Pang, J.: A graph attention mechanism-based multiagent reinforcement-learning method for task scheduling in edge computing. Electronics 11(9), 1357 (2022)
Taleb, T., Samdanis, K., Mada, B., Flinck, H., Dutta, S., Sabella, D.: On multi-access edge computing: A survey of the emerging 5G network edge cloud architecture and orchestration. IEEE Commun. Surv. Tutorials. 19(3), 1657–1681 (2017)
Zhao, F., Chen, Y., Zhang, Y., Liu, Z., Chen, X.: Dynamic offloading and resource scheduling for mobile-edge computing with energy harvesting devices. IEEE Trans. Netw. Serv. Manage. 18(2), 2154–2165 (2021)
Lu, C., Zheng, J., Yin, L., Wang, R.: An improved iterated greedy algorithm for the distributed hybrid flowshop scheduling problem. Eng. Optim. (2023)
Lu, C., Gao, R., Yin, L., Zhang, B.: Human-Robot Collaborative Scheduling in Energy-efficient Welding Shop. IEEE Trans. Ind. Inform. (2023)
Deng, Y., Du, S., Wang, D., Shao, Y., Huang, D.A.: Calibration-based hybrid transfer learning Framework for RUL Prediction of Rolling Bearing Across different machines. IEEE Trans. Instrum. Meas. 72 (2023)
Li, B., Tan, Y., Wu, A., Duan, G.: A distributionally robust optimization based method for stochastic model predictive control. IEEE Trans. Autom. Control, 67(11), 5762–57762021
Lu, Z., Cheng, R., **, Y., Tan, K.C., Deb, K.: Neural Architecture Search as Multiobjective optimization benchmarks: Problem Formulation and Performance Assessment. IEEE Trans. Evol. Comput. (2022)
Li, L., Wang, P., Zheng, X., **e, Q., Tao, X., ... Velásquez, J. D.: Dual-interactive fusion for code-mixed deep representation learning in tag recommendation. Inf. Fusion. 101862 (2023)
Li, Q., Lin, H., Tan, X., Du, S.: Consensus for Multiagent-Based Supply Chain Systems under switching Topology and Uncertain demands. IEEE Trans. Syst. Man Cybern.: Syst. 50(12), 4905–49182020
Wang, B., Shen, Y., Li, N., Zhang, Y., Gao, Z.: An Adaptive Sliding mode fault-tolerant Control of a Quadrotor Unmanned Aerial Vehicle with Actuator Faults and Model Uncertainties. Int. J. Robust Nonlinear Control (2023)
Wang, B., Zhang, Y., Zhang, W.A.: Composite Adaptive Fault-Tolerant attitude control for a Quadrotor UAV with multiple uncertainties. J. Syst. Sci. Complex. 35(1), 81–1042022
Yao, Y., Shu, F., Li, Z., Cheng, X., Wu, L.: Secure transmission Scheme Based on Joint Radar and Communication in Mobile Vehicular Networks. IEEE Trans. Intell. Transp. Syst. (2023)
Zhang, X., Wang, Z., Lu, Z.: Multi-objective load dispatch for microgrid with electric vehicles using modified gravitational search and particle swarm optimization algorithm. Appl. Energy. 306, 118018 (2022)
Shruthi, G., Mundada, M.R., Sowmya, B.J., Supreeth, S.: Mayfly taylor optimisation-based scheduling algorithm with deep reinforcement learning for dynamic scheduling in fog-cloud computing. Appl. Comput. Intell. Soft Comput. 2022 (2022)
Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. stat. 1050(20), 10–48550 (2017)
Cao, B., Zhao, J., Gu, Y., Ling, Y., Ma, X.: Applying graph-based differential grou** for multiobjective large-scale optimization. Swarm Evol. Comput. 53, 100626 (2020)
Tian, G., Hui, Y., Lu, W., Tingting, W.: Rate-distortion optimized quantization for geometry-based point cloud compression. J. Electron. Imaging. 32(1), 13047 (2023)
Zhang, J., Zhu, C., Zheng, L., Xu, K.: ROSEFusion: Random optimization for online dense reconstruction under fast camera motion. ACM Trans. Graphics, 40(4), 1–172021
Zhang, J., Tang, Y., Wang, H., Xu, K.: ASRO-DIO: Active subspace random optimization based depth inertial odometry. IEEE Trans. Robot., 1–13 (2022)
Yan, J., Bi, S., Zhang, Y.J.A.: Offloading and resource allocation with general task graph in mobile edge computing: A deep reinforcement learning approach. IEEE Trans. Wirel. Commun. 19(8), 5404–5419 (2020)
Chabi, S., Boni, A.K., Hablatou, Y., Hassan, H., Drira, K.: Distributed deep reinforcement learning architecture for task offloading in autonomous IoT systems. In: Proceedings of the 12th international conference on the Internet of Things, pp. 112–118 (2022)
Yue, S., Ren, J., Qiao, N., Zhang, Y., Jiang, H., Zhang, Y., Yang, Y.: TODG: Distributed task offloading with delay guarantees for edge computing. IEEE Trans. Parallel Distrib. Syst. 33(7), 1650–1665 (2021)
Tan, J., **, H., Hu, H., Hu, R., Zhang, H., ... Zhang, H.: WF-MTD: Evolutionary decision method for moving target defense based on wright-fisher process. IEEE Trans. Dependable Secure Comput. (2022)
Cheng, B., Zhu, D., Zhao, S., Chen, J.: Situation-aware IoT Service Coordination using the event-driven SOA paradigm. IEEE Trans. Netw. Serv. Manage. 13(2), 349–3612016
Zhuang, Y., Chen, S., Jiang, N., Hu, H.: An effective WSSENet-based similarity retrieval method of large lung CT image databases. KSII Trans. Internet Inform. Syst. 16(7) (2022)
Zhuang, Y., Jiang, N., Xu, Y., **angjie, K., Kong, X.: Progressive distributed and parallel similarity retrieval of large CT image sequences in mobile telemedicine networks. Wirel. Commun. Mob. Comput. 2022 (2022)
Tuli, S., Ilager, S., Ramamohanarao, K., Buyya, R.: Dynamic scheduling for stochastic edge-cloud computing environments using a3c learning and residual recurrent neural networks. IEEE Trans. Mob. Comput. 21(3), 940–954 (2020)
Tang, Y., Liu, S., Deng, Y., Zhang, Y., Yin, L.,… Zheng, W.: An improved method for soft tissue modeling. Biomed. Signal Process. Control 65 (2021)
Lu, S., Liu, S., Hou, P., Yang, B., Liu, M., Yin, L.,… Zheng, W.: Soft tissue feature tracking based on deep matching network. Comput. Model. Eng. Sci. 136(1), 363–379 (2023)
Dai, X., **ao, Z., Jiang, H., Lui, J.C.: S. UAV-assisted task offloading in vehicular edge computing networks. IEEE Trans. Mob. Comput. (2023)
Cao, B., Zhang, J., Liu, X., Sun, Z., Cao, W., Nowak, R. M.,… Lv, Z.: Edge–cloud resource scheduling in space–air–ground-integrated networks for internet of vehicles. IEEE Internet Things J. 9(8), 5765–5772 (2022)
Wang, Y., Liu, H., Zheng, W., **a, Y., Li, Y., Chen, P., Guo, K., **e, H.: Multi-objective workflow scheduling with deep-Q-network-based multi-agent reinforcement learning. IEEE Access. 7, 39974–39982 (2019)
Zervoudakis, K., Tsafarakis, S.: A mayfly optimization algorithm. Comput. Ind. Eng. 145, 106559 (2020)
Alipour, P.: The dual reciprocity boundary elements method for one-dimensional nonlinear parabolic partial differential equations. ar**v preprint ar**v:2305.12210. (2023)
Wang, B., Wang, X., Wang, N., Javaheri, Z., Moghadamnejad, N., Abedi, M.: Machine learning optimization model for reducing the electricity loads in residential energy forecasting. Sustain. Comput.: Inform. Syst. 38, 100876 (2023)
Larijani, A., Dehghani, F.: Stock price prediction using the combination of Firefly (FA) and genetic algorithms. Available at SSRN 4448024 (2023)
Cao, B., Fan, S., Zhao, J., Tian, S., Zheng, Z., Yan, Y.,… Yang, P.: Large-scale many-objective deployment optimization of edge servers. IEEE Trans. Intell. Transp Syst. 22(6), 3841–3849 (2021)
Zhang, X., Fang, S., Shen, Y., Yuan, X., Lu, Z.: Hierarchical velocity optimization for Connected Automated Vehicles with Cellular Vehicle-to-everything communication at continuous Signalized Intersections. IEEE Trans. Intell. Transp. Syst. (2023)
Author information
Authors and Affiliations
Contributions
Dacheng Chen: Conceptualization, Methodology, Formal analysis, Supervision, Writing - original draft, Writing - review & editing. **nhua Liu: Investigation, Data Curation, Validation, Resources, Writing - review & editing.
Corresponding author
Ethics declarations
Ethics Approval and Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, D., Liu, X. Mayfly Taylor Optimization-Based Graph Attention Network for Task Scheduling in Edge Computing. J Grid Computing 21, 53 (2023). https://doi.org/10.1007/s10723-023-09685-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10723-023-09685-8