Skip to main content
The VLM Run Gateway applies per-tier rate limits on POST /v1/openai/chat/completions. Limits are enforced in memory; when you exceed a bucket, the API returns 429 Too Many Requests. See Authentication for how tiers are determined.

Limits by Tier

Anonymous and authenticated users share the same numeric limits today. The difference is how traffic is attributed: anonymous requests are capped per IP, while authenticated requests are capped per user account.
Sign up at app.vlm.run for a free API key. An API key lets you attribute usage to your account and avoids sharing a rate limit bucket with other users on the same IP.
When a limit is exceeded, the Gateway returns HTTP 429. See Error Codes for the response body and handling guidance.

Tips

  • Back off and retry after a short delay when you receive a 429.
  • Prefer URL-based document inputs over large base64 payloads to keep request latency predictable under load.
  • For production document workloads, use an authenticated API key so limits apply to your account rather than a shared IP bucket.
If you need higher limits, contact support@vlm.run.