Abstract
Background: With recent improvements in fog computing, it is now feasible to offer faster response time and better service delivery quality; however, the impending challenge is to place the fog nodes within the environment optimally. A review of existing literature showcases that consideration of joint problems such as fog node placement and resource management are less reported. Irrespective of different available methodologies, it is noted that a learning scheme facilitates better capability to incorporate intelligence in the network device, which can act as an enabling technique for superior operation of fog nodes.
Objectives: The prime objective of the study is to introduce simplified and novel computational modelling toward the optimal placement of fog nodes with improved resource allocation mechanisms concerning bandwidth.
Methods: Implemented in Python, the proposed scheme performs predictive operations using the Deep Deterministic Policy Gradient (DDPG) method. Markov modelling is used to frame the model. OpenAI Gym library is used for environment modelling, bridging communication between the environment and the learning agent.
Results: Quantitative results indicate that the proposed scheme performs better than existing schemes by approximately 30%.
Conclusion: The prime innovative approach introduced is the implementation of a reinforcement learning algorithm with a Markov chain towards enriching the predictive analytical capabilities of the controller system with faster service relaying operations.
Graphical Abstract
[1]
Tomar R, Katal A, Dahiya S, Singh N, Choudhury T. Fog computing: Concepts, frameworks, and applications. (1st ed.), Boca Raton: Chapman and Hall/CRC 2022.
[http://dx.doi.org/10.1201/9781003188230]
[http://dx.doi.org/10.1201/9781003188230]
[2]
Temene N, Sergiou C, Ioannou C, Georgiou C, Vassiliou V. A node placement algorithm utilizing mobile nodes in WSN and IoT networks. Telecom 2022; 3(1): 17-51.
[http://dx.doi.org/10.3390/telecom3010002]
[http://dx.doi.org/10.3390/telecom3010002]
[3]
Ghobaei-Arani M, Souri A, Rahmanian AA. Resource management approaches in fog computing: A comprehensive review. J Grid Comput 2020; 18(1): 1-42.
[http://dx.doi.org/10.1007/s10723-019-09491-1]
[http://dx.doi.org/10.1007/s10723-019-09491-1]
[4]
Sadashiv N, Kumar SMD. Broker-based resource management in dynamic multi-cloud environment. Int J High Perform Comput Netw 2018; 12(1): 94-109.
[http://dx.doi.org/10.1504/IJHPCN.2018.093845]
[http://dx.doi.org/10.1504/IJHPCN.2018.093845]
[5]
Kansal S. “Basic concepts of cloud and fog computing,” in Internet of things. Singapore: Springer. Nat Singap 2022; pp. 23-36.
[6]
Goudarzi M, Wu H, Palaniswami M, Buyya R. An application placement technique for concurrent iot applications in edge and fog computing environments. IEEE Trans Mobile Comput 2021; 20(4): 1298-311.
[http://dx.doi.org/10.1109/TMC.2020.2967041]
[http://dx.doi.org/10.1109/TMC.2020.2967041]
[7]
Misra S, Tiwari M, Ojha T, Raj Y. Panda: Preference based bandwidth allocation in fog-enabled internet of underground-mine things. IEEE Syst J 2021; 15(4): 5144-51.
[http://dx.doi.org/10.1109/JSYST.2021.3086150]
[http://dx.doi.org/10.1109/JSYST.2021.3086150]
[8]
Mani SK, Meenakshisundaram I. Improving quality‐of‐service in fog computing through efficient resource allocation. Comput Intell 2020; 36(4): 1527-47.
[http://dx.doi.org/10.1111/coin.12285]
[http://dx.doi.org/10.1111/coin.12285]
[9]
Sheikh Sofla M, Haghi Kashani M, Mahdipour E, Faghih Mirzaee R. Towards effective offloading mechanisms in fog computing. Multimedia Tools Appl 2022; 81(2): 1997-2042.
[http://dx.doi.org/10.1007/s11042-021-11423-9] [PMID: 34690529]
[http://dx.doi.org/10.1007/s11042-021-11423-9] [PMID: 34690529]
[10]
Wang H, Liu T, Kim B, et al. Architectural design alternatives based on cloud/edge/fog computing for connected vehicles. IEEE Commun Surv Tutor 2020; 22(4): 2349-77.
[http://dx.doi.org/10.1109/COMST.2020.3020854]
[http://dx.doi.org/10.1109/COMST.2020.3020854]
[11]
Tran-Dang H, Bhardwaj S, Rahim T, Musaddiq A, Kim DS. Reinforcement learning based resource management for fog computing environment: Literature review, challenges, and open issues. J Commun Netw (Seoul) 2022; 24(1): 83-98.
[http://dx.doi.org/10.23919/JCN.2021.000041]
[http://dx.doi.org/10.23919/JCN.2021.000041]
[12]
Jumnal A. SM DK. Energy-aware reinforcement learning based dynamic vm placement approach for cloud data centers
[13]
Mann ZA. Decentralized application placement in fog computing. IEEE Trans Parallel Distrib Syst 2022; 33(12): 3262-73.
[http://dx.doi.org/10.1109/TPDS.2022.3148985]
[http://dx.doi.org/10.1109/TPDS.2022.3148985]
[14]
Mouradian C, Kianpisheh S, Abu-Lebdeh M, Ebrahimnezhad F, Jahromi NT, Glitho RH. Application component placement in nfvbased hybrid cloud/fog systems with mobile fog nodes. IEEE J Sel Areas Comm 2019; 37(5): 1130-43.
[http://dx.doi.org/10.1109/JSAC.2019.2906790]
[http://dx.doi.org/10.1109/JSAC.2019.2906790]
[15]
Nashaat H, Ahmed E, Rizk R. Iot application placement algorithm based on multi-dimensional qoe prioritization model in fog computing environment. IEEE Access 2020; 8: 253-64.
[http://dx.doi.org/10.1109/ACCESS.2020.3003249]
[http://dx.doi.org/10.1109/ACCESS.2020.3003249]
[16]
Alharbi H A, Elgorashi T E, Elmirghani J M. Energy efficient virtual machines placement over cloud-fog network architecture. IEEE Access 2020; 8: 697-718.
[http://dx.doi.org/10.1109/ACCESS.2020.2995393]
[http://dx.doi.org/10.1109/ACCESS.2020.2995393]
[17]
Tinini RI, Batista DM, Figueiredo GB, Tornatore M, Mukherjee B. Low-latency and energy-efficient bbu placement and vpon formation in virtualized cloud-fog ran. J Opt Commun Netw 2019; 11(4): B37-48.
[http://dx.doi.org/10.1364/JOCN.11.000B37]
[http://dx.doi.org/10.1364/JOCN.11.000B37]
[18]
Chiti F, Fantacci R, Paganelli F, Picano B. Virtual functions placement with time constraints in fog computing: A matching theory perspective. IEEE Trans Netw Serv Manag 2019; 16(3): 980-9.
[http://dx.doi.org/10.1109/TNSM.2019.2918637]
[http://dx.doi.org/10.1109/TNSM.2019.2918637]
[19]
Mseddi A, Jaafar W, Elbiaze H, Ajib W. Joint container placement and task provisioning in dynamic fog computing. IEEE Internet Things J 2019; 6(6): 28-40.
[http://dx.doi.org/10.1109/JIOT.2019.2935056]
[http://dx.doi.org/10.1109/JIOT.2019.2935056]
[20]
Herrera JL, Galan-Jimenez J, Foschini L, Bellavista P, Berrocal J, Murillo JM. Qos-aware fog node placement for intensive iot applications in sdn-fog scenarios. IEEE Internet Things J 2022; 9(15): 13725-39.
[http://dx.doi.org/10.1109/JIOT.2022.3143948]
[http://dx.doi.org/10.1109/JIOT.2022.3143948]
[21]
Manogaran G, Rawal BS. An efficient resource allocation scheme with optimal node placement in iot-fog-cloud architecture. IEEE Sens J 2021; 21(22): 106-13.
[http://dx.doi.org/10.1109/JSEN.2021.3057224]
[http://dx.doi.org/10.1109/JSEN.2021.3057224]
[22]
Mahmud R, Toosi AN, Ramamohanarao K, Buyya R. Context aware placement of industry 4.0 applications in fog computing environments. IEEE Trans Industr Inform 2020; 16(11): 7004-13.
[http://dx.doi.org/10.1109/TII.2019.2952412]
[http://dx.doi.org/10.1109/TII.2019.2952412]
[23]
Zhu J, Huang X, Gao X, Shao Z, Yang Y. Multi-interface channel allocation in fog computing systems using thompson sampling. IEEE Internet Things J 2021; 8(17): 42-54.
[http://dx.doi.org/10.1109/JIOT.2021.3066048]
[http://dx.doi.org/10.1109/JIOT.2021.3066048]
[24]
Mukherjee M, Kumar S, Zhang Q, Matam R, Mavromoustakis C X. Task data offloading and resource allocation in fog computing with multi-task delay guarantee. IEEE Access 2019; 7: 152911-8.
[25]
Gu K, Tang L, Jiang J, Jia W. Resource allocation scheme for community-based fog computing based on reputation mechanism. IEEE Trans Comput Soc Syst 2020; 7(5): 1246-63.
[http://dx.doi.org/10.1109/TCSS.2020.3005761]
[http://dx.doi.org/10.1109/TCSS.2020.3005761]
[26]
Raveendran N, Zhang H, Song L, Wang L-C, Hong CS, Han Z. Pricing and resource allocation optimization for iot fog computing and nfv: An epec and matching based perspective. IEEE Trans Mobile Comput 2020; 21(4): 1349-61.
[27]
Yi C, Huang S, Cai J. Joint resource allocation for device-to-device communication assisted fog computing. IEEE Trans Mobile Comput 2021; 20(3): 1076-91.
[http://dx.doi.org/10.1109/TMC.2019.2952354]
[http://dx.doi.org/10.1109/TMC.2019.2952354]
[28]
Gao X, Huang X, Bian S, Shao Z, Yang Y. Pora: Predictive offloading and resource allocation in dynamic fog computing systems. IEEE Internet Things J 2020; 7(1): 72-87.
[http://dx.doi.org/10.1109/JIOT.2019.2945066]
[http://dx.doi.org/10.1109/JIOT.2019.2945066]
[29]
Rehman A U, Ahmad Z, Jehangiri A I, Ala’Anzy MA, et al. Dynamic energy efficient resource allocation strategy for load balancing in fog environment. IEEE Access 2020; 8: 829-39.
[30]
Chang Z, Liu L, Guo X, Sheng Q. Dynamic resource allocation and computation offloading for iot fog computing system. IEEE Trans Industr Inform 2021; 17(5): 3348-57.
[http://dx.doi.org/10.1109/TII.2020.2978946]
[http://dx.doi.org/10.1109/TII.2020.2978946]
[31]
Peng X, Ota K, Dong M. Multiattribute-based double auction toward resource allocation in vehicular fog computing. IEEE Internet Things J 2020; 7(4): 3094-103.
[http://dx.doi.org/10.1109/JIOT.2020.2965009]
[http://dx.doi.org/10.1109/JIOT.2020.2965009]
[32]
Jie Y, Guo C, Choo KKR, Liu CZ, Li M. Game-theoretic resource allocation for fog-based industrial internet of things environment. IEEE Internet Things J 2020; 7(4): 3041-52.
[http://dx.doi.org/10.1109/JIOT.2020.2964590]
[http://dx.doi.org/10.1109/JIOT.2020.2964590]
[33]
Ismail N, Hossain MA, Md Noor R, Wahab AWA. Enhanced congestion control model based on message prioritization and scheduling mechanism in vehicle-to-infrastructure (V2I). J Phys Conf Ser 2022; 2312(1): 012087.
[http://dx.doi.org/10.1088/1742-6596/2312/1/012087]
[http://dx.doi.org/10.1088/1742-6596/2312/1/012087]
[34]
Hagiescu A, Bordoloi UD, Chakraborty S, Sampath P, Ganesan PVV, Ramesh S. Performance analysis of flexray-based ECU networks 2007 44th ACM/IEEE Design Automation Conference San Diego, CA. USA284-9.
[35]
Mittal S, Dudeja RK, Bali RS, Aujla GS. A distributed task orchestration scheme in collaborative vehicular cloud edge networks. Comput 2022.
[http://dx.doi.org/10.1007/s00607-022-01119-9]
[http://dx.doi.org/10.1007/s00607-022-01119-9]
[36]
Zhou Y, Li H, Shi C, Lu N, Cheng N. A fuzzy-rule based data delivery scheme in VANETs with intelligent speed prediction and relay selection. Wirel Commun Mob Comput 2018; 2018: 1-15.
[http://dx.doi.org/10.1155/2018/7637059]
[http://dx.doi.org/10.1155/2018/7637059]
[37]
Vemireddy S, Rout RR. Fuzzy Reinforcement Learning for energy efficient task offloading in Vehicular Fog Computing. Comput Netw 2021; 199: 108463.
[http://dx.doi.org/10.1016/j.comnet.2021.108463]
[http://dx.doi.org/10.1016/j.comnet.2021.108463]
[38]
Naouri A, Nouri NA, Dhelim S, Khelloufi A, Ben Sada A, Ning H. Efficient fog node placement using nature-inspired metaheuristic for IoT applications. Available from:
http://arxiv.org/abs/2302.05948[Accessed: 24-Nov-2023]
[39]
Hussein MK, Mousa MH. Efficient task offloading for iot-based applications in fog computing using ant colony optimization. IEEE Access 2020; 8: 37191-201.
[http://dx.doi.org/10.1109/ACCESS.2020.2975741]
[http://dx.doi.org/10.1109/ACCESS.2020.2975741]
[40]
Singh S, Vidyarthi DP. Fog node placement using multi-objective genetic algorithm. Int J Inf Technol 2023.
[http://dx.doi.org/10.1007/s41870-023-01530-1]
[http://dx.doi.org/10.1007/s41870-023-01530-1]
[41]
Mukherjee A, De D, Ghosh SK. FogIoHT: A weighted majority game theory based energy-efficient delay-sensitive fog network for internet of health thingsInternet of Things. Elsevier 2020; p. 11.
[42]
Salimian M, Ghobaei-Arani M, Shahidinejad A. An evolutionary multi-objective optimization technique to deploy the IoT services in fog-enabled networks: An autonomous approach. Appl Artif Intell 2022; 36(1): 2008149.
[http://dx.doi.org/10.1080/08839514.2021.2008149]
[http://dx.doi.org/10.1080/08839514.2021.2008149]
[43]
Ramzanpoor Y, Hosseini Shirvani M, Golsorkhtabaramiri M. Multi-objective fault-tolerant optimization algorithm for deployment of IoT applications on fog computing infrastructure. ComplexIntell Syst 2022; 8(1): 361-92.
[http://dx.doi.org/10.1007/s40747-021-00368-z]
[http://dx.doi.org/10.1007/s40747-021-00368-z]
[44]
Hussain MM, Azar AT, Ahmed R, et al. SONG: A multi-objective evolutionary algorithm for delay and energy aware facility location in vehicular fog networks. Sensors 2023; 23(2): 667.
[http://dx.doi.org/10.3390/s23020667] [PMID: 36679463]
[http://dx.doi.org/10.3390/s23020667] [PMID: 36679463]
[45]
Yin Z, Xu F, Li Y, et al. A multi-objective task scheduling strategy for intelligent production line based on cloud-fog computing. Sensors 2022; 22(4): 1555.
[http://dx.doi.org/10.3390/s22041555] [PMID: 35214456]
[http://dx.doi.org/10.3390/s22041555] [PMID: 35214456]
[46]
Alatoun K, Matrouk K, Mohammed MA, Nedoma J, Martinek R, Zmij P. A novel low-latency and energy-efficient task scheduling framework for internet of medical things in an edge fog cloud system. Sensors 2022; 22(14): 5327.
[http://dx.doi.org/10.3390/s22145327] [PMID: 35891007]
[http://dx.doi.org/10.3390/s22145327] [PMID: 35891007]
[47]
Lin CC, Deng DJ, Suwatcharachaitiwong S, Li YS. Dynamic weighted fog computing device placement using a bat-inspired algorithm with dynamic local search selection. Mob Netw Appl 2020; 25(5): 1805-15.
[http://dx.doi.org/10.1007/s11036-020-01565-9]
[http://dx.doi.org/10.1007/s11036-020-01565-9]
[48]
Ilyas A, Alatawi MN, Hamid Y, et al. Software architecture for pervasive critical health monitoring system using fog computing. J Cloud Comput 2022; 11(1): 84.
[http://dx.doi.org/10.1186/s13677-022-00371-w] [PMID: 36465318]
[http://dx.doi.org/10.1186/s13677-022-00371-w] [PMID: 36465318]
Related Journals
Recent Advances in Computer Science and Communications
Related Books
Challenges and Opportunities for Deep Learning Applications in Industry 4.0
Recent Advances in IoT and Blockchain Technology
Augmented Intelligence: Deep Learning, Machine Learning, Cognitive Computing, Educational Data Mining
Human-Computer Interaction and Beyond: Advances Towards Smart and Interconnected Environments Part II
Machine Learning and Its Application: A Quick Guide for Beginners
Computational Intelligence For Data Analysis
Applied Machine Learning and Multi-Criteria Decision-Making in Healthcare
Advanced Computing Techniques: Implementation, Informatics and Emerging Technologies
How to Design Optimization Algorithms by Applying Natural Behavioral Patterns
Human-Computer Interaction and Beyond: Advances Towards Smart and Interconnected Environments (Part I)
