Load Balancing in Cloud Computing: A State of the Art Survey

Full Text (PDF, 603KB), PP.64-78

Views: 0 Downloads: 0


Mohammadreza Mesbahi 1,* Amir Masoud Rahmani 1

1. Science and Research Branch, Islamic Azad University, Tehran, Iran

* Corresponding author.

DOI: https://doi.org/10.5815/ijmecs.2016.03.08

Received: 6 Nov. 2015 / Revised: 25 Dec. 2015 / Accepted: 1 Feb. 2016 / Published: 8 Mar. 2016

Index Terms

Cloud Computing, Load Balancing, Distributed Systems, Virtual Machine


Cloud computing has proposed a new perspective for provisioning the large-scale computing resources by using virtualization technology and a pay-per-use cost model. Load balancing is taken into account as a vital part for parallel and distributed systems. It helps cloud computing systems by improving the general performance, better computing resources utilization, energy consumption management, enhancing the cloud services' QoS, avoiding SLA violation and maintaining system stability through distribution, controlling and managing the system workloads. In this paper we study the necessary requirements and considerations for designing and implementing a suitable load balancer for cloud environments. In addition we represent a complete survey of current proposed cloud load balancing solutions which according to our classification, they can be classified into three categories: General Algorithm-based, Architectural-based and Artificial Intelligence-based load balancing mechanisms. Finally, we propose our evaluation of these solutions based on suitable metrics and discuss their pros and cons.

Cite This Paper

Mohammadreza Mesbahi, Amir Masoud Rahmani, "Load Balancing in Cloud Computing: A State of the Art Survey", International Journal of Modern Education and Computer Science(IJMECS), Vol.8, No.3, pp.64-78, 2016. DOI:10.5815/ijmecs.2016.03.08


[1]Foster, I., et al. Cloud computing and grid computing 360-degree compared. in Grid Computing Environments Workshop, 2008. GCE'08. 2008. Ieee.
[2]Rastogi, G. and R. Sushil, Cloud Computing Implementation: Key Issues and Solutions, in 2nd International Conference on Computing for Sustainable Global Development (INDIACom)2015, IEEE. p. 320-324.
[3]Lee Badger, T.G., Robert Patt, Corner JeffVoas. DRAFT Cloud Computing Synopsis and Recommendations. 2011; Available from:
[4]Puthal, D., et al., Cloud Computing Features, Issues, and Challenges: A Big Picture, in International Conference on Computational Intelligence and Networks (CINE)2015, IEEE. p. 116-123.
[5]Jadeja, Y. and K. Modi. Cloud computing-concepts, architecture and challenges. in Computing, Electronics and Electrical Technologies (ICCEET), 2012 International Conference on. 2012. IEEE.
[6]Rimal, B.P., E. Choi, and I. Lumb. A taxonomy and survey of cloud computing systems. in INC, IMS and IDC, 2009. NCM'09. Fifth International Joint Conference on. 2009. Ieee.
[7]Zissis, D. and D. Lekkas, Addressing cloud computing security issues. Future Generation Computer Systems, 2012. 28(3): p. 583-592.
[8]Subashini, S. and V. Kavitha, A survey on security issues in service delivery models of cloud computing. Journal of Network and Computer Applications, 2011. 34(1): p. 1-11.
[9]Khan, A.N., et al., Towards secure mobile cloud computing: A survey. Future Generation Computer Systems, 2012.
[10]1Lombardi, F. and R. Di Pietro, Secure virtualization for cloud computing. Journal of Network and Computer Applications, 2011. 34(4): p. 1113-1122.
[11]Khorshed, M.T., A. Ali, and S.A. Wasimi, A survey on gaps, threat remediation challenges and some thoughts for proactive attack detection in cloud computing. Future Generation Computer Systems, 2012. 28(6): p. 833-851.
[12]Mauch, V., M. Kunze, and M. Hillenbrand, High performance cloud computing. Future Generation Computer Systems, 2012.
[13]Ghosh, R., et al., Modeling and performance analysis of large scale IaaS Clouds. Future Generation Computer Systems, 2012.
[14]Garg, S.K., S. Versteeg, and R. Buyya, A framework for ranking of cloud computing services. Future Generation Computer Systems, 2013. 29(4): p. 1012-1023.
[15]Pérez-Miguel, C., A. Mendiburu, and J. Miguel-Alonso, Modeling the availability of Cassandra. Journal of Parallel and Distributed Computing, 2015.
[16]Sousa, E., et al., A Modeling Approach for Cloud Infrastructure Planning Considering Dependability and Cost Requirements. IEEE Transactions on Systems, Man, and Cybernetics: Systems, , 2015. 45(4): p. 549-558.
[17]Yang, X., et al., A business-oriented Cloud federation model for real-time applications. Future Generation Computer Systems, 2012. 28(8): p. 1158-1167.
[18]Dukaric, R. and M.B. Juric, Towards a unified taxonomy and architecture of cloud frameworks. Future Generation Computer Systems, 2012.
[19]Fu, S., C.-Z. Xu, and H. Shen, Randomized load balancing strategies with churn resilience in peer-to-peer networks. Journal of Network and Computer Applications, 2011. 34(1): p. 252-261.
[20]Wu, D., Y. Tian, and K.-W. Ng, Resilient and efficient load balancing in distributed hash tables. Journal of Network and Computer Applications, 2009. 32(1): p. 45-60.
[21]Raj, J.S. and R. Fiona. Load balancing techniques in grid environment: A survey. in Computer Communication and Informatics (ICCCI), 2013 International Conference on. 2013. IEEE.
[22]Randles, M., et al. A Comparative Experiment in Distributed Load Balancing. in Developments in eSystems Engineering (DESE), 2009 Second International Conference on. 2009. IEEE.
[23]Khan, R.Z. and M.F. Ali, An Efficient Diffusion Load Balancing Algorithm in Distributed System. International Journal of Information Technology and Computer Science (IJITCS), 2014. 6(8): p. 65.
[24]Mohamed, N., J. Al-Jaroodi, and A. Eid, A Dual-Direction Technique for Fast File Downloads with Dynamic Load Balancing in the Cloud. Journal of Network and Computer Applications, 2013.
[25]Nuaimi, K.A., et al. A Survey of Load Balancing in Cloud Computing: Challenges and Algorithms. in Network Cloud Computing and Applications (NCCA), 2012 Second Symposium on. 2012. IEEE.
[26]Suresh, M., K.B. Santhosh, and S. Karthik. A Load Balancing Model in Public Cloud Using ANFIS and GSO. in Intelligent Computing Applications (ICICA), 2014 International Conference on. 2014. IEEE.
[27]Kanakala, R. and V.K. Reddy, Performance Analysis of Load Balancing Techniques in Cloud Computing Environment. TELKOMNIKA Indonesian Journal of Electrical Engineering, 2015. 13(3): p. 568-573.
[28]Poddar, R., A. Vishnoi, and V. Mann, HAVEN: Holistic Load Balancing and Auto Scaling in the Cloud, in 7th International Conference on Communication Systems and Networks (COMSNETS)2015.
[29]Alakeel, A.M., A guide to dynamic load balancing in distributed computer systems. International Journal of Computer Science and Information Security, 2010. 10(6): p. 153-160.
[30]Rimal, B.P., et al., Architectural requirements for cloud computing systems: an enterprise cloud approach. Journal of Grid Computing, 2011. 9(1): p. 3-26.
[31]Khiyaita, A., et al. Load balancing cloud computing: state of art. in Network Security and Systems (JNS2), 2012 National Days of. 2012. IEEE.
[32]Zenon, C., M. Venkatesh, and A. Shahrzad, Availability and Load Balancing in Cloud Computing. 2011.
[33]Alexeev, Y., et al. Heuristic static load-balancing algorithm applied to the fragment molecular orbital method. in High Performance Computing, Networking, Storage and Analysis (SC), 2012 International Conference for. 2012. IEEE.
[34]Chonggun, K. and H. Kameda, Optimal static load balancing of multi-class jobs in a distributed computer system. IEICE TRANSACTIONS (1976-1990), 1990. 73(7): p. 1207-1214.
[35]Penmatsa, S. and A.T. Chronopoulos, Game-theoretic static load balancing for distributed systems. Journal of Parallel and Distributed Computing, 2011. 71(4): p. 537-555.
[36]Cosenza, B., et al. Distributed load balancing for parallel agent-based simulations. in Parallel, Distributed and Network-Based Processing (PDP), 2011 19th Euromicro International Conference on. 2011. IEEE.
[37]Shi, J., C. Meng, and L. Ma. The Strategy of Distributed Load Balancing Based on Hybrid Scheduling. in Computational Sciences and Optimization (CSO), 2011 Fourth International Joint Conference on. 2011. IEEE.
[38]Gonzalez-Ruiz, A. and Y. Mostofi. Distributed load balancing over directed network topologies. in American Control Conference, 2009. ACC'09. 2009. IEEE.
[39]Riakiotakis, I., et al., Distributed dynamic load balancing for pipelined computations on heterogeneous systems. Parallel Computing, 2011. 37(10): p. 713-729.
[40]Ahmad, I. and A. Ghafoor. A semi distributed load balancing scheme for large multicomputer systems. in Parallel and Distributed Processing, 1990. Proceedings of the Second IEEE Symposium on. 1990. IEEE.
[41]Ahmad, I. and A. Ghafoor, Semi-distributed load balancing for massively parallel multicomputer systems. Software Engineering, IEEE Transactions on, 1991. 17(10): p. 987-1004.
[42]Zhu, W., C. Sun, and C. Shieh. Comparing the performance differences between centralized load balancing methods. in Systems, Man, and Cybernetics, 1996., IEEE International Conference on. 1996. IEEE.
[43]Das, S., H. Viswanathan, and G. Rittenhouse. Dynamic load balancing through coordinated scheduling in packet data systems. in INFOCOM 2003. Twenty-Second Annual Joint Conference of the IEEE Computer and Communications. IEEE Societies. 2003. IEEE.
[44]Patni, J.C., et al. Load balancing strategies for Grid computing. in Electronics Computer Technology (ICECT), 2011 3rd International Conference on. 2011. IEEE.

[45]Rajavel, R. De-Centralized Load Balancing for the Computational Grid environment. in Communication and Computational Intelligence (INCOCCI), 2010 International Conference on. 2010. IEEE.
[46]Ni, L.M., C.-W. Xu, and T.B. Gendreau, A distributed drafting algorithm for load balancing. Software Engineering, IEEE Transactions on, 1985(10): p. 1153-1161.
[47]Baumgartner, K.M. and B.W. Wah. A global load balancing strategy for a distributed computer system. in Distributed Computing Systems in the 1990s, 1988. Proceedings., Workshop on the Future Trends of. 1988. IEEE.
[48]Felber, P., et al., Survey on Load Balancing in Peer-to-Peer Distributed Hash Tables.
[49]Dinan, J., et al. Dynamic load balancing of unbalanced computations using message passing. in Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International. 2007. IEEE.
[50]Lee, G.-H. Using system state information for adaptive state polling policy in distributed load balancing. in Parallel Algorithms/Architecture Synthesis, 1997. Proceedings. Second Aizu International Symposium. 1997. IEEE.
[51]Brazier, F., et al. Agents negotiating for load balancing of electricity use. in Distributed Computing Systems, 1998. Proceedings. 18th International Conference on. 1998. IEEE.
[52]Cao, J., et al. Agent-based grid load balancing using performance-driven task scheduling. in Parallel and Distributed Processing Symposium, 2003. Proceedings. International. 2003. IEEE.
[53]Eager, D.L., E.D. Lazowska, and J. Zahorjan, A comparison of receiver-initiated and sender-initiated adaptive load sharing. Performance evaluation, 1986. 6(1): p. 53-68.
[54]Eager, D.L., E.D. Lazowska, and J. Zahorjan, Adaptive load sharing in homogeneous distributed systems. Software Engineering, IEEE Transactions on, 1986(5): p. 662-675.
[55]Evans, D. and W. Butt, Dynamic load balancing using task-transfer probabilities. Parallel Computing, 1993. 19(8): p. 897-916.
[56]Goswami, K.K., M. Devarakonda, and R.K. Iyer, Prediction-based dynamic load-sharing heuristics. Parallel and Distributed Systems, IEEE Transactions on, 1993. 4(6): p. 638-648.
[57]Yang, C.-C., C. Chen, and J.-Y. Chen. Random early detection web servers for dynamic load balancing. in Pervasive Systems, Algorithms, and Networks (ISPAN), 2009 10th International Symposium on. 2009. IEEE.
[58]Chechina, N., P. King, and P. Trinder. Using negotiation to reduce redundant autonomous mobile program movements. in Web Intelligence and Intelligent Agent Technology (WI-IAT), 2010 IEEE/WIC/ACM International Conference on. 2010. IEEE.
[59]Randles, M., D. Lamb, and A. Taleb-Bendiab. A comparative study into distributed load balancing algorithms for cloud computing. in Advanced Information Networking and Applications Workshops (WAINA), 2010 IEEE 24th International Conference on. 2010. IEEE.
[60]Wu, T.-Y., et al. Dynamic load balancing mechanism based on cloud storage. in Computing, Communications and Applications Conference (ComComAp), 2012. 2012. IEEE.
[61]Rahman, A., X. Liu, and F. Kong, A Survey on Geographic Load Balancing Based Data Center Power
Management in the Smart Grid Environment.
[62]Beloglazov, A., J. Abawajy, and R. Buyya, Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Computer Systems, 2012. 28(5): p. 755-768.
[64]Lee, R. and B. Jeng. Load-balancing tactics in cloud. in Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 2011 International Conference on. 2011. IEEE.
[65]Gupta, P., M.K. Goyal, and P. Kumar. Trust and reliability based load balancing algorithm for cloud IaaS. in Advance Computing Conference (IACC), 2013 IEEE 3rd International. 2013. IEEE.
[66]Sarood, O., A. Gupta, and L.V. Kalé. Cloud Friendly Load Balancing for HPC Applications: Preliminary Work. in Parallel Processing Workshops (ICPPW), 2012 41st International Conference on. 2012. IEEE.
[67]Wang, S.-C., et al. Towards a load balancing in a three-level cloud computing network. in Computer Science and Information Technology (ICCSIT), 2010 3rd IEEE International Conference on. 2010. IEEE.
[68]Mondal, B., K. Dasgupta, and P. Dutta, Load Balancing in Cloud Computing using Stochastic Hill Climbing-A Soft Computing Approach. Procedia Technology, 2012. 4: p. 783-789.
[69]Simjanoska, M., et al. L3B: Low level load balancer in the cloud. in EUROCON, 2013 IEEE. 2013. IEEE.
[70]Xu, G., J. Pang, and X. Fu, A load balancing model based on cloud partitioning for the public cloud. Tsinghua Science and Technology, 2013. 18(1): p. 34-39.
[71]Wang, R., W. Le, and X. Zhang, Design and implementation of an efficient load-balancing method for virtual machine cluster based on cloud service. 2011.
[72]Tian, W., et al. A dynamic and integrated load-balancing scheduling algorithm for Cloud datacenters. in Cloud Computing and Intelligence Systems (CCIS), 2011 IEEE International Conference on. 2011. IEEE.
[73]Ma, F., F. Liu, and Z. Liu. Distributed load balancing allocation of virtual machine in cloud data center. in Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on. 2012. IEEE.
[74]Chen, J.-L., Y.T. Larosa, and P.-J. Yang. Optimal QoS load balancing mechanism for virtual machines scheduling in Eucalyptus cloud computing platform. in Future Internet Communications (BCFIC), 2012 2nd Baltic Congress on. 2012. IEEE.
[75]Nishant, K., et al. Load Balancing of Nodes in Cloud Using Ant Colony Optimization. in Computer Modelling and Simulation (UKSim), 2012 UKSim 14th International Conference on. 2012. IEEE.
[76]Ghafari, S.M., et al. Bee-MMT: A load balancing method for power consumption management in cloud computing. in Contemporary Computing (IC3), 2013 Sixth International Conference on. 2013. IEEE.
[77]Yao, J. and J.-h. He. Load balancing strategy of cloud computing based on artificial bee algorithm. in Computing Technology and Information Management (ICCM), 2012 8th International Conference on. 2012. IEEE.
[78]Kansal, N.J. and I. Chana, Cloud Load Balancing Techniques: A Step Towards Green Computing. IJCSI International Journal of Computer Science Issues, 2012. 9(1): p. 238-246.

[79]Calheiros, R.N., et al., CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and Experience, 2011. 41(1): p. 23-50.
[80]Wickremasinghe, B., R.N. Calheiros, and R. Buyya. Cloudanalyst: A cloudsim-based visual modeller for analysing cloud computing environments and applications. in Advanced Information Networking and Applications (AINA), 2010 24th IEEE International Conference on. 2010. IEEE.