Audio -> JSON

VLM Run

Extract JSON from images, videos, and documents with a unified API.

Introduction

Extract JSON from images, videos, and documents with type-safety.

Structured Responses

Extract JSON from images, videos, and documents with custom schemas.

Custom Schemas

Run VLM-1 with the OpenAI Python SDK with just 2 lines of code change.

OpenAI Compatibility

Run `vlm-1` with the Instructor Python SDK with minimal code changes.

Instructor Compatibility

The VLM Run Hub is a collection of pre-defined domains and schemas for structured data extraction.

Hub Catalog

Extract structured data from long documents and reports.

Parsing Documents

Extract structured data from rich visual PDFs and presentations.

Parsing Presentations

Parsing Resumes

Parsing Invoices

Learn how to extract structured data from TV news broadcasts.

Understanding TV News

Learn how to analyze video podcasts using our Video Transcription API.

Understanding Video Podcasts

Learn how to generate captions, tags and descriptions for images.

Image Cataloging

Learn how to fine-tune `vlm-1` for your use-case.

MongoDB

ChromaDB

Rate limits to consider when using the API.

Rate Limits

List of error codes that you may encounter when using the API

Error Codes

Health

Get models

List domains

Get the JSON schema for a given domain (document.invoice, document.receipt, etc).

Get schema for domain

Generate structured prediction for the given image.

Image -> JSON

Generate structured prediction for the given document.

Doc -> JSON

Get Predictions by ID

Get all predictions uploaded by the user with pagination.

Get Predictions List

Upload file

Get File by ID

Get all files uploaded by the user with pagination.

List Files

Create Finetuning Job

Generate a response from a fine-tuned model.

Finetuned Inference

List Finetuning Jobs

Get Finetuning Job

Create chat completion

List all models

Getting Started with the VLM Run Python SDK

Getting Started

client

client.files

client.models

client.hub

client.image

client.document

client.audio

client.video

CLI Overview

Learn how to install and use the VLM Run Node.js SDK

VLM Run Node.js SDK Client Configuration and Usage

Learn how to upload and manage files with the VLM Run Node.js SDK

Learn how to work with models in the VLM Run Node.js SDK

Learn how to process images with the VLM Run Node.js SDK

Learn how to process documents with the VLM Run Node.js SDK

Learn how to process audio files with the VLM Run Node.js SDK

Models

Hub

Generate

Predictions

Files

Fine-Tuning

OpenAI Compatibility

Audio -> JSON