Also called: throttling, quota
A cap on how many requests or tokens you can send in a window.
Why it mattersHits hardest at demo time. Build in retries with backoff before you need them.
Rate Limit
A cap on how many requests or tokens you can send in a window.
Explore more AI terms
Browse the full glossary for plain-English definitions across models, agents, data, and safety.
Back to all terms