Custom Schema Generator Demo
Navigate over to the schema generator on our dashboard to build custom schemas from your own data.
vlm-1
also supports custom schemas that allows you to define your own schema for a specific domain or use-case. This feature allows you to extract structured data that conforms to your specific needs and requirements, while still leveraging all the vision-based reasoning capabilities of vlm-1
(see Capabilities section for more details).
What are Custom Schemas?
Custom schemas define the structure and validation rules for the data you want to extract from visual content. For example, you can use Pydantic or Zod models to specify exactly which fields you need, their types, and validation rules - passing the schema to the API will ensure our VLM will extract the data in exactly the format you defined.Benefits of Custom Schemas
- Type Safety: Enforce proper data types and validation rules
- Flexibility: Extract only the data you need in the format you prefer
- Integration: Seamlessly connect with your existing data models and systems
- Customization: Create domain-specific extraction rules tailored to your use case
Type-based data validation for LLMs have been popularized by tools like Instructor and LangChain, however we take it a step further by instrumenting new capabilities on top of your schemas such as visual grounding, confidence scores, GQL querying and much more.