Microservice adaptive circuit breaking and rate limiting mechanisms

• 1、Beijing University of Posts and Telecommunications, School of Computer Science, Beijing, 100876

Abstract：The proposal of service architecture has brought a great impact on the field of service design architecture. More and more traditional service architectures are transforming into microservice architectures. Microservice encapsulation technology and microservice orchestration technology have been developed, and Service Mesh service grid architecture has been derived to leave the basic communication to the service grid. Although Service Mesh can ensure service stability by providing circuit breaking, ratelimiting, etc., and provide inter-service communication to ensure the service quality of microservice clusters in general,the current Service Mesh tools are not sufficient to guarantee the service quality in the changing network environment. To address the problem of service quality assurance in different network environment situations and the current status of the popular service grid management technology, this paper proposes a new circuit breaking and rate limiting mechanisms that usethe current system resources to dynamically request rejection probability and ratelimiting threshold. Experiments show that the adaptive circuit breaking and rate limiting mechanisms in this paper can effectively reduce the service request latency and improve the request success rate.

Keywords： microservices cloud native circuit breaking rate limiting