Improving Performance with API Gateway Caching and Throttling

Authors: Surbhi Kanthed

DOI: https://doi.org/10.5281/zenodo.15086802

Short DOI: https://doi.org/g89tng

Country: United States

Full-text Research PDF File:   View   |   Download

Abstract: API gateways serve as a unified entry point for client requests in microservices and distributed systems. They enforce cross-cutting concerns, such as authentication and routing, while regulating resource usage. Two primary mechanisms for improving performance and resource efficiency are caching—which stores frequently requested data—and throttling, which limits request rates to avoid overload. This paper provides a comprehensive survey of caching and throttling techniques in API gateways, emphasizing their technical underpinnings, existing literature, real world case studies and a reference framework that outlines how these mechanisms can be integrated. Additionally, it presents a overview of popular API gateways that implement caching and throttling features. The paper concludes with a discussion of security considerations, open research questions, and future directions in this domain.

Keywords: API Gateway, Caching, Throttling, Rate Limiting, Request Management, Load Balancing, Microcaching, Token Bucket Algorithm, Traffic Control, Cloud APIs, Performance Optimization, Response Time Reduction, API Security, Service Scalability, Request Routing.

Paper Id: 232292

Published On: 2023-11-25

Published In: Volume 11, Issue 6, November-December 2023

Share this