Optimizing Service Selection and Load Balancing in Multi-Cluster Microservice Systems with MCOSS

Daniel Bachar, Anat Bremler-Barr, David Hay

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the advent of cloud and container technologies, enterprises develop applications using a microservices architecture, managed by orchestration systems (e.g. Kubernetes), that group the microservices into clusters. As the number of application setups across multiple clusters and different clouds is increasing, technologies that enable communication and service discovery between the clusters are emerging (mainly as part of the Cloud Native ecosystem). In such a multi-cluster setting, copies of the same microservice may be deployed in different geo-locations, each with different cost and latency penalties. Yet, current service selection and load balancing mechanisms do not take into account these locations and corresponding penalties. We present MCOSS, a novel solution for optimizing the service selection, given a certain microservice deployment among clouds and clusters in the system. Our solution is agnostic to the different multi-cluster networking layers, cloud vendors, and discovery mechanisms used by the operators. Our simulations show a reduction in outbound traffic cost by up to 72% and response time by up to 64%, compared to the currently-deployed service selection mechanisms.

Original languageEnglish
Title of host publication2023 IFIP Networking Conference, IFIP Networking 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9783903176577
DOIs
StatePublished - 2023
Event22nd International Federation for Information Processing Conference on Networking, IFIP Networking 2023 - Barcelona, Spain
Duration: 12 Jun 202315 Jun 2023

Publication series

Name2023 IFIP Networking Conference, IFIP Networking 2023

Conference

Conference22nd International Federation for Information Processing Conference on Networking, IFIP Networking 2023
Country/TerritorySpain
CityBarcelona
Period12/06/2315/06/23

Keywords

  • Cloud Computing
  • Kubernetes
  • Load Balancing
  • Microservices
  • Multi-Cloud
  • Multi-Cluster
  • Optimization

Fingerprint

Dive into the research topics of 'Optimizing Service Selection and Load Balancing in Multi-Cluster Microservice Systems with MCOSS'. Together they form a unique fingerprint.

Cite this