Adaptive Resource Scheduling in Serverless Architectures for Low-Latency Microservices

Abstract

With the transformation of cloud computing, micro services are progressively implemented on serverless architecture because of the nature of scalability, cost effectiveness, and lack of infrastructure management. Nevertheless, the ability to provide low-latency operation to microservices in an unpredictable and dynamically changing serverless computing environment is one of the primary challenges. Adaptive resource scheduling mechanisms are discussed in this paper as a solution to generate a consistent low-latency response in serverless microservice deployments. The focus is on the analysis of bottlenecks in the performance of the runtime, scheduling algorithms, cold start mitigation, and load balancing in real time. Containers orchestration, lifecycle management of functionalities, and AI-assisted scheduling in the context of cloud-native ecosystems are the recent advancements that form the basis of the discussion. Adaptive resource scheduling can be an important addition to serverless systems, which can enhance the responsiveness, reliability, and scalability of microservices.