Abstract
In this paper, we focus on the cloud-edge collaborative network, where a task is decomposed into a set of functions and could be offloaded to different computing nodes, which is referred to as Function Computation Offloading (FCO). One of the most important problems in FCO is to schedule the functions in computing nodes to achieve low latency and high reliability. We formulate FCO scheduling in the Cloud-edge Collaborative Network as mixed-integer nonlinear programming. The objective is to minimise the end-to-end delay of a task while satisfying the latency and reliability constraints. To solve the problem, we propose an efficient mechanism to decide the redundancy of functions according to the reliability requirements. Then, we deploy the non-redundant functions on the computing nodes. Finally, we present a Reinforcement Learning (RL) to learn the scheduling policy of the redundant functions to further reduce the end-to-end delay of the task. Simulation results show that our proposed algorithm can significantly reduce tasks’ completion time by about 13–26% with fewer iterations compared with other alternatives.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Cai, J., Fu, H., Liu, Y.: Multitask multiobjective deep reinforcement learning-based computation offloading method for industrial internet of things. IEEE Internet Things J. 10(2), 1848–1859 (2023). https://doi.org/10.1109/JIOT.2022.3209987
Cao, Z., Zhou, P., Li, R., Huang, S., Wu, D.O.: Multiagent deep reinforcement learning for joint multichannel access and task offloading of mobile-edge computing in industry 4.0. IEEE Internet Things J. 7(7), 6201–6213 (2020). https://doi.org/10.1109/JIOT.2020.2968951
Chen, Q., Kuang, Z., Zhao, L.: Multiuser computation offloading and resource allocation for cloud-edge heterogeneous network. IEEE Internet Things J. 9(5), 3799–3811 (2022). https://doi.org/10.1109/JIOT.2021.3100117
Chen, Z., Yi, W., Alam, A.S., Nallanathan, A.: Dynamic task software caching-assisted computation offloading for multi-access edge computing. IEEE Trans. Commun. 70(10), 6950–6965 (2022). https://doi.org/10.1109/TCOMM.2022.3200109
Ding, Y., Li, K., Liu, C., Li, K.: A potential game theoretic approach to computation offloading strategy optimization in end-edge-cloud computing. IEEE Trans. Parallel Distrib. Syst. 33(6), 1503–1519 (2022). https://doi.org/10.1109/TPDS.2021.3112604
Du, M., Wang, Y., Ye, K., Xu, C.: Algorithmics of cost-driven computation offloading in the edge-cloud environment. IEEE Trans. Comput. 69(10), 1519–1532 (2020). https://doi.org/10.1109/TC.2020.2976996
Fantacci, R., Picano, B.: Performance analysis of a delay constrained data offloading scheme in an integrated cloud-fog-edge computing system. IEEE Trans. Veh. Technol. 69(10), 12004–12014 (2020). https://doi.org/10.1109/TVT.2020.3008926
Guo, K., Gao, R., **a, W., Quek, T.Q.S.: Online learning based computation offloading in MEC systems with communication and computation dynamics. IEEE Trans. Commun. 69(2), 1147–1162 (2021). https://doi.org/10.1109/TCOMM.2020.3038875
Haber, E.E., Alameddine, H.A., Assi, C., Sharafeddine, S.: UAV-aided ultra-reliable low-latency computation offloading in future IoT networks. IEEE Trans. Commun. 69(10), 6838–6851 (2021). https://doi.org/10.1109/TCOMM.2021.3096559
Hu, J., Li, K., Liu, C., Chen, J., Li, K.: Coalition formation for deadline-constrained resource procurement in cloud computing. J. Parallel Distrib. Comput. 149, 1–12 (2021). https://doi.org/10.1016/j.jpdc.2020.10.004
Jia, J., Yang, L., Cao, J.: Reliability-aware dynamic service chain scheduling in 5G networks based on reinforcement learning. In: 40th IEEE Conference on Computer Communications, INFOCOM 2021, Vancouver, BC, Canada, 10–13 May 2021, pp. 1–10. IEEE (2021). https://doi.org/10.1109/INFOCOM42981.2021.9488707
Liang, B., Ji, W.: Multiuser computation offloading for edge-cloud collaboration using submodular optimization. Tongxin Xuebao/J. Commun. 41(10), 25–36 (2020). communication resources;Computation offloading;Computing-task;Edge clouds;Greedy algorithms;Mode selection;Stable systems;Submodular optimizations. https://doi.org/10.11959/j.issn.1000-436x.2020205
Lin, C., Mahmoudi, N., Fan, C., Khazaei, H.: Fine-grained performance and cost modeling and optimization for Faas applications. IEEE Trans. Parallel Distrib. Syst. 34(1), 180–194 (2023). https://doi.org/10.1109/TPDS.2022.3214783
Liu, G., **ao, Z., Tan, G., Li, K., Chronopoulos, A.T.: Game theory-based optimization of distributed idle computing resources in cloud environments. Theor. Comput. Sci. 806, 468–488 (2020). https://doi.org/10.1016/j.tcs.2019.08.019
Peng, J., Qiu, H., Cai, J., Xu, W., Wang, J.: D2d-assisted multi-user cooperative partial offloading, transmission scheduling and computation allocating for MEC. IEEE Trans. Wirel. Commun. 20(8), 4858–4873 (2021). https://doi.org/10.1109/TWC.2021.3062616
Qiu, C., Wang, X., Yao, H., Du, J., Yu, F.R., Guo, S.: Networking integrated cloud-edge-end in IoT: a blockchain-assisted collective Q-learning approach. IEEE Internet Things J. 8(16), 12694–12704 (2021). https://doi.org/10.1109/JIOT.2020.3007650
Qiu, T., Chi, J., Zhou, X., Ning, Z., Atiquzzaman, M., Wu, D.O.: Edge computing in industrial internet of things: architecture, advances and challenges. IEEE Commun. Surv. Tut. 22(4), 2462–2488 (2020). https://doi.org/10.1109/COMST.2020.3009103
Qu, L., Assi, C., Shaban, K.B., Khabbaz, M.J.: A reliability-aware network service chain provisioning with delay guarantees in NFV-enabled enterprise datacenter networks. IEEE Trans. Netw. Serv. Manag. 14(3), 554–568 (2017). https://doi.org/10.1109/TNSM.2017.2723090
Ren, J., Yu, G., He, Y., Li, G.Y.: Collaborative cloud and edge computing for latency minimization. IEEE Trans. Veh. Technol. 68(5), 5031–5044 (2019). https://doi.org/10.1109/TVT.2019.2904244
Riera, J.F., Escalona, E., Batalle, J., Grasa, E., Garcia-Espin, J.A.: Virtual network function scheduling: concept and challenges, Vilanova i la Geltru, Spain (2014). complex scheduling;Network functions;Network services;Proof of concept;Routing function;Scheduling problem;State of the art;Virtual networks. https://doi.org/10.1109/SaCoNeT.2014.6867768
Shah-Mansouri, H., Wong, V.W.S.: Hierarchical fog-cloud computing for IoT systems: a computation offloading game. IEEE Internet Things J. 5(4), 3246–3257 (2018). https://doi.org/10.1109/JIOT.2018.2838022
Sun, C., et al.: Task offloading for end-edge-cloud orchestrated computing in mobile networks. In: 2020 IEEE Wireless Communications and Networking Conference, WCNC 2020, Seoul, South Korea, 25–28 May 2020, pp. 1–6. IEEE (2020). https://doi.org/10.1109/WCNC45663.2020.9120496
Wang, C., Zhang, S., Chen, Y., Qian, Z., Wu, J., **ao, M.: Joint configuration adaptation and bandwidth allocation for edge-based real-time video analytics. In: 39th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, ON, Canada, 6–9 July 2020, pp. 257–266. IEEE (2020). https://doi.org/10.1109/INFOCOM41043.2020.9155524
Wang, C., Yu, F.R., Liang, C., Chen, Q., Tang, L.: Joint computation offloading and interference management in wireless cellular networks with mobile edge computing. IEEE Trans. Veh. Technol. 66(8), 7432–7445 (2017). https://doi.org/10.1109/TVT.2017.2672701
Yang, H., **e, X., Kadoch, M.: Intelligent resource management based on reinforcement learning for ultra-reliable and low-latency IoV communication networks. IEEE Trans. Veh. Technol. 68(5), 4157–4169 (2019). https://doi.org/10.1109/TVT.2018.2890686
Yang, Y., Long, C., Wu, J., Peng, S., Li, B.: D2D-enabled mobile-edge computation offloading for multiuser IoT network. IEEE Internet Things J. 8(16), 12490–12504 (2021). https://doi.org/10.1109/JIOT.2021.3068722
You, C., Huang, K., Chae, H., Kim, B.: Energy-efficient resource allocation for mobile-edge computation offloading. IEEE Trans. Wirel. Commun. 16(3), 1397–1411 (2017). https://doi.org/10.1109/TWC.2016.2633522
Zhan, Y., Guo, S., Li, P., Zhang, J.: A deep reinforcement learning based offloading game in edge computing. IEEE Trans. Comput. 69(6), 883–893 (2020). https://doi.org/10.1109/TC.2020.2969148
Zhang, J., Du, J., Shen, Y., Wang, J.: Dynamic computation offloading with energy harvesting devices: a hybrid-decision-based deep reinforcement learning approach. IEEE Internet Things J. 7(10), 9303–9317 (2020). https://doi.org/10.1109/JIOT.2020.3000527
Zhang, L., Cao, B., Li, Y., Peng, M., Feng, G.: A multi-stage stochastic programming-based offloading policy for fog enabled IoT-ehealth. IEEE J. Sel. Areas Commun. 39(2), 411–425 (2021). https://doi.org/10.1109/JSAC.2020.3020659
Zhao, M., et al.: Energy-aware task offloading and resource allocation for time-sensitive services in mobile edge computing systems. IEEE Trans. Veh. Technol. 70(10), 10925–10940 (2021). https://doi.org/10.1109/TVT.2021.3108508
Zhao, N., Du, W., Ren, F., Pei, Y., Liang, Y., Niyato, D.: Joint task offloading, resource sharing and computation incentive for edge computing networks. IEEE Commun. Lett. 27(1), 258–262 (2023). https://doi.org/10.1109/LCOMM.2022.3220233
Zhou, H., Jiang, K., Liu, X., Li, X., Leung, V.C.M.: Deep reinforcement learning for energy-efficient computation offloading in mobile-edge computing. IEEE Internet Things J. 9(2), 1517–1530 (2022). https://doi.org/10.1109/JIOT.2021.3091142
Zhu, X., Luo, Y., Liu, A., Bhuiyan, M.Z.A., Zhang, S.: Multiagent deep reinforcement learning for vehicular computation offloading in IoT. IEEE Internet Things J. 8(12), 9763–9773 (2021). https://doi.org/10.1109/JIOT.2020.3040768
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, S., **e, Y., Li, Z., Qi, J., Tian, Y. (2024). Reliable Function Computation Offloading in Cloud-Edge Collaborative Network. In: Tari, Z., Li, K., Wu, H. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2023. Lecture Notes in Computer Science, vol 14488. Springer, Singapore. https://doi.org/10.1007/978-981-97-0801-7_25
Download citation
DOI: https://doi.org/10.1007/978-981-97-0801-7_25
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-0800-0
Online ISBN: 978-981-97-0801-7
eBook Packages: Computer ScienceComputer Science (R0)