GLOSSARY > API GATEWAY
API Gateway
A server that acts as an API front-end, receiving API requests, enforcing throttling and security policies, and routing them to the back-end.
The API Gateway is the central enforcement point for Control Boundaries in a microservices architecture. When deploying Private AI, the API Gateway inspects all inbound prompts and outbound LLM responses, ensuring rate limits, enforcing authorization, and providing a single choke point to detect and block Prompt Injection attempts before they reach the model.
Explore More

