base_url at https://gateway.vlm.run/v1/openai and your existing SDK calls keep working.
Why the Gateway
General-purpose model routers are built for text LLMs, so they cover only a thin slice of visual workloads. The Gateway is built for vision models:- One API, many models. Every model speaks OpenAI’s own request shapes, on one
base_urland one API key. See Models. - Document routing built in. Multi-page PDFs are rasterized and fanned out per page for you, with no splitting or stitching.
- Method and DPI routing.
methodpicks the operation (ocr,detect,markdown, …);document_dpitunes how much page detail the model sees. - Operational signals included. A live
model catalog, per-request
usage.cost, andx-request-idon every response. - Drop-in for agents. The MCP server exposes file-reading tools to any MCP-aware framework.
Next steps
Quickstart
Prerequisites, plus first VQA and document OCR requests.
Flexible Document OCR
Request knobs, page blocks, and streaming for PDFs.
Models
Catalog, capabilities, and model selection.
Methods
Method and
method_params reference.Pricing
Per-token rates, and per-request
usage.cost.MCP Server
Connect any MCP-aware agent (Pydantic AI, LangChain, Mastra, Claude Code).