Hierarchical Model and Decision Optimization Algorithm for Distributed Data Storage and Processing
https://doi.org/10.31854/1813-324X-2023-9-2-112-127
Abstract
The task of optimizing distributed data storage and processing is difficult to solve in a limited time. In this regard, a hierarchical approach has been applied to solve it, which provides for the presentation of a generalized problem in the form of a set of hierarchically ordered subtasks, for each of which locally optimal solutions are determined at the appropriate hierarchy level. To optimize solutions for distributed data storage and processing, a process model has been formed, presented in the form of a set of hierarchically ordered components, a mathematical model of a hierarchical game, which is a way to optimize solutions at hierarchy levels. In order to determine effective solutions at hierarchy levels, an algorithm for local optimization of solutions based on genetic algorithms has been developed. The construction of data processing schedules assigned to computing devices is implemented using the proposed heuristic procedure. The application of the developed models of the distributed data storage and processing process, hierarchical game models and algorithms for optimizing solutions made it possible to significantly increase the dimension of the problem, take into account the parameters characterizing data transmission channels when optimizing solutions at hierarchy levels, and minimize the amount of unused resources.
About the Author
K. KrotovRussian Federation
Sevastopol, 299053, Russian Federation
References
1. Prajapati H.B., Shah V.A. Scheduling in Grid Computing Environment. Proceedings of the Fourth International Conference on Advanced Computing & Communication Technologie, 08‒09 February 2014s, Rohtak, India. IEEE; 2014. p.315‒324. DOI:10.1109/ACCT.2014.32
2. Bhatia M.K. Task Scheduling in Grid Computing: A Review. Advances in Computational Sciences and Technology. 2017;10(6):1707‒1714.
3. Xhafa F., Barolli L., Durresi A. Batch mode scheduling in grid systems. International Journal of Web and Grid Services. 2007;3(1):19–37. DOI:10.1504/IJWGS.2007.012635
4. Khan M. Design and Analysis of Security Aware Scheduling in Grid Computing Environment. International Journal of Computer Science and Information Technology Research (IJCSITR). 2013;1(1):42‒50.
5. Naresh U. Study on Many-Task-Computing using Data Aware Scheduling in Cloud Computing. International Journal of Innovations & Advancement in Computer Science (IJIACS). 2017;6(9):360‒366.
6. Mahajan S., Kaur R. A Concern towards Job scheduling in Cluster Computing. International Journal of Computer Engineering in Research Trends. 2015;2(6):392‒394.
7. Abawajy J.H. Dynamic Parallel Job Scheduling in Multi-cluster Computing Systems. Proceedings of the 4th International Conference of Computer Science, ICCS 2004, 6‒9 June 2004, Kraków, Poland. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer; 2004. vol.3036. p. 27–34. DOI:10.1007/978-3-540-24685-5_4
8. Alworafi M.A., Dhari A., El-Booz Sh.A., Mallappa S. Budget-aware task scheduling technique for efficient management of cloud resources. International Journal High Performance Computing and Networking. 2019;14(4):453‒465. DOI:10.1504/IJHPCN.2019.102352
9. Arabnejad V., Bubendorfer K., Ng B. Budget and Deadline Aware e-Science Workflow Scheduling in Clouds. IEEE Transactions on Parallel and Distributed Systems. 2019;30(1):29‒44. DOI:10.1109/TPDS.2018.2849396
10. Mesarovich M., Mako D., Takahara I. Theory of Hierarchical Multilevel Systems. Moscow: Mir Publ.; 1973. 344 p. (in Russ.)
11. Voronin A.A., Mishin S.P. Optimal Hierarchical Structures. Moscow: V.A. Trapeznikov Institute of Management Problems Publ.; 2003. 214 p. (in Russ.)
12. Gubko M.V., Novikov D.A. Game Theory in the Management of Organizational Systems. Moscow: V.A. Trapeznikov Institute of Management Problems Publ.; 2005. 138 p. (in Russ.)
13. Burkov V.N., Korgin N.A., Novikov D.A. Introduction to the Theory of Management of Organizational Systems. Moscow: Librocom Publ.; 2009. 264 p.(in Russ.)
14. Busygin V.P., Zhelobodko E.V., Kokovin S.G., Tsyplakov A.A. Microeconomic Analysis of Imperfect Markets. Novosibirsk: Novosibirsk State University Publ.; 1999. 132 p. (in Russ.)
15. Gladkov L.A., Kureychik V.V., Kureychik V.M. Genetic Algorithms. M.: Fizmatlit Publ.; 2006. 320 p. (in Russ.)
16. Kureychik V.M. Genetic Algorithms and Their Application. Taganrog: Taganrog Radio Engineering University Publ.; 2002. 244 p. (in Russ.)
17. Smirnov A.V. On the Problem of Packaging in Containers. Successes of Mathematical Sciences. 1991;46(4):173‒174. (in Russ.)
Review
For citations:
Krotov K. Hierarchical Model and Decision Optimization Algorithm for Distributed Data Storage and Processing. Proceedings of Telecommunication Universities. 2023;9(2):112-127. (In Russ.) https://doi.org/10.31854/1813-324X-2023-9-2-112-127