> ## Documentation Index
> Fetch the complete documentation index at: https://docs.vlm.run/llms.txt
> Use this file to discover all available pages before exploring further.

# Supported Domains

> Pre-built schemas and domain definitions for common data extraction tasks.

The [VLM Run Hub](https://github.com/vlm-run/vlmrun-hub) is a collection of pre-defined domains and schemas for structured data extraction.

## Document Domains

| <div class="domain-column">Domain</div>                                 |                 <div class="allowed-inputs-column">Allowed Inputs</div>                | <div class="description-column">Description</div>                                                                                                                                            |
| :---------------------------------------------------------------------- | :------------------------------------------------------------------------------------: | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [document.bank-statement](/api-reference/v1/post-document-generate)     | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Bank statement data extraction system that processes bank statements to extract structured financial transaction information including account details, balances, and transaction history.   |
| [document.classification](/api-reference/v1/post-document-generate)     | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Classify documents into one or more categories based on their content, visual features, and metadata.                                                                                        |
| [document.invoice](/api-reference/v1/post-document-generate)            | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Comprehensive invoice data extraction system that processes invoice images to extract structured information including invoice metadata, customer details, line items, and financial totals. |
| [document.markdown](/api-reference/v1/post-document-generate)           | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Convert document pages into a highly-accurate content descriptions, including table and chart content.                                                                                       |
| [document.q-and-a](/api-reference/v1/post-document-generate)            | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Convert document pages into a highly-accurate content descriptions, including table and chart content.                                                                                       |
| [document.receipt](/api-reference/v1/post-document-generate)            | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Receipt data extraction system that processes receipt images to extract structured information including transaction details, merchant information, and financial totals.                    |
| [document.resume](/api-reference/v1/post-document-generate)             | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Resume data extraction system that processes resume images to extract structured information including contact details, education, work experience, skills, and additional sections.         |
| [document.us-drivers-license](/api-reference/v1/post-document-generate) | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Driver's license information extraction system that processes driver's license images to extract structured information including name, address, date of birth, and license details.         |
| [document.utility-bill](/api-reference/v1/post-document-generate)       | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Utility bill data extraction system that processes utility bill images to extract structured information including account details, billing period, charges, and payment information.        |

## Image Domains

| <div class="domain-column">Domain</div>                       | <div class="allowed-inputs-column">Allowed Inputs</div> | <div class="description-column">Description</div>                                                |
| :------------------------------------------------------------ | :-----------------------------------------------------: | :----------------------------------------------------------------------------------------------- |
| [image.classification](/api-reference/v1/post-image-generate) |         <span class="tag tag-image">image</span>        | Classify the image into one of the following categories: \[category1, category2, category3, ...] |
| [image.caption](/api-reference/v1/post-image-generate)        |         <span class="tag tag-image">image</span>        | Extract the caption from the image.                                                              |
| [image.tv-news](/api-reference/v1/post-image-generate)        |         <span class="tag tag-image">image</span>        | Extract the TV news segment from the image.                                                      |
| [image.q-and-a](/api-reference/v1/post-image-generate)        |         <span class="tag tag-image">image</span>        | Answer questions about an image.                                                                 |

## Audio Domains

| <div class="domain-column">Domain</div>                      | <div class="allowed-inputs-column">Allowed Inputs</div> | <div class="description-column">Description</div>                                                                                                                          |
| :----------------------------------------------------------- | :-----------------------------------------------------: | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [audio.transcription](/api-reference/v1/post-audio-generate) |         <span class="tag tag-audio">audio</span>        | Gain a competitive edge with real-time analytics from audio, helping you track trending topics, public sentiment, and influential quotes that shape audience perspectives. |

## Video Domains

Video domains can be used to analyze video content, including transcribing the video content, summarizing the video content, and analyzing the video content. They are categorized into 3 types:

* **Whole-video Summary** (<kbd>summary</kbd>): Analyze the whole video content.
* **Segmented Summary** (<kbd>segmented-summary</kbd>): Analyze the entire video content and summarize it into multiple segments (key moments, scenes, highlights, etc.). You can provide prompts and cues to guide the segmentation, and the number of segments can be specified (e.g. "Find 5 key moments in this video where the CEO mentions "AI").
* **Segmented Analysis** (<kbd>segmented-analysis</kbd>): Analyze the video content per-segment, with each segment extracting detailed information prompted via the custom video segment model (e.g. [`json_schema`](/api-reference/v1/post-video-generate#body-config-json-schema)). Each segment is automatically detected with audio and visual cues (e.g. silence, new scene, etc.)

| <div class="domain-column">Domain</div>                              |              <div class="allowed-inputs-column">Allowed Inputs</div>             | <div class="type-column">Type</div> | <div class="description-column">Description</div>                                                                                                                                                                    |
| :------------------------------------------------------------------- | :------------------------------------------------------------------------------: | :---------------------------------: | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [video.transcription](/api-reference/v1/post-video-generate)         |                     <span class="tag tag-video">video</span>                     |    <kbd>segmented-analysis</kbd>    | Transcribe video content, including timestamps, visual descriptions, audio transcriptions, summaries, and topic identification.                                                                                      |
| [video.transcription-summary](/api-reference/v1/post-video-generate) |                     <span class="tag tag-video">video</span>                     |     <kbd>segmented-summary</kbd>    | Analyze video content by breaking it into 5-minute segments with detailed visual and audio analysis, including timestamps, visual descriptions, audio transcriptions, summaries, and topic identification.           |
| [video.product-demo-summary](/api-reference/v1/post-video-generate)  |                     <span class="tag tag-video">video</span>                     |     <kbd>segmented-summary</kbd>    | Analyze video content by breaking it into 5-minute segments with detailed visual and audio analysis, including timestamps, visual descriptions, audio transcriptions, summaries, and topic identification.           |
| [video.conferencing-summary](/api-reference/v1/post-video-generate)  |                     <span class="tag tag-video">video</span>                     |     <kbd>segmented-summary</kbd>    | Analyze conferencing videos to extract structured information including segments, topics, presenters, and key events for comprehensive conferencing monitoring and analysis.                                         |
| [video.podcast-summary](/api-reference/v1/post-video-generate)       |                     <span class="tag tag-video">video</span>                     |     <kbd>segmented-summary</kbd>    | Analyze podcast videos to extract structured information including segments, topics, presenters, and key events for comprehensive podcast monitoring and analysis.                                                   |
| [video.summary](/api-reference/v1/post-video-generate)               |                     <span class="tag tag-video">video</span>                     |          <kbd>summary</kbd>         | Analyze whole video content by summarizing the video content into a concise 2-3 sentence summary, and providing a list of topics discussed in the video, at most 5 topics. Use the provided topics enum if possible. |
| [video.dashcam-analytics](/api-reference/v1/post-video-generate)     | <span class="tag tag-image">image</span><span class="tag tag-video">video</span> |          <kbd>summary</kbd>         | Analyze dashcam footage to identify and classify events, objects, and situations relevant to road safety and vehicle monitoring, including traffic conditions, incidents, and environmental factors.                 |

## Industry-specific Domains

| <div class="domain-column">Domain</div>                                        |                 <div class="allowed-inputs-column">Allowed Inputs</div>                | <div class="description-column">Description</div>                                                                                                                                    |
| :----------------------------------------------------------------------------- | :------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [aerospace.remote-sensing](/api-reference/v1/post-image-generate)              |    <span class="tag tag-image">image</span><span class="tag tag-video">video</span>    | Satellite image analysis system for identifying and categorizing geographical features, infrastructure, and environmental elements from aerial imagery.                              |
| [healthcare.patient-consent](/api-reference/v1/post-document-generate)         |                     <span class="tag tag-document">document</span>                     | Extract the information from the provided document and fill in the consent model accordingly. If you aren't sure, leave it blank.                                                    |
| [healthcare.patient-identification](/api-reference/v1/post-document-generate)  | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Extract the information from the provided document and fill in the identification model accordingly. If you aren't sure, leave it blank.                                             |
| [healthcare.patient-insurance-card](/api-reference/v1/post-document-generate)  | <span class="tag tag-document">document</span><span class="tag tag-image">image</span> | Extract the information from the provided document and fill in the insurance card model accordingly. If you aren't sure, leave it blank.                                             |
| [healthcare.patient-intake](/api-reference/v1/post-document-generate)          |                     <span class="tag tag-document">document</span>                     | Extract the information from the provided document and fill in the intake form model accordingly. If you aren't sure, leave it blank.                                                |
| [healthcare.patient-medical-history](/api-reference/v1/post-document-generate) |                     <span class="tag tag-document">document</span>                     | Extract the information from the provided document and fill in the medical history model accordingly. If you aren't sure, leave it blank.                                            |
| [healthcare.patient-referral](/api-reference/v1/post-document-generate)        |                     <span class="tag tag-document">document</span>                     | Extract the information from the provided document and fill in the patient referral record model accordingly. If you aren't sure, leave it blank.                                    |
| [retail.ecommerce-product-caption](/api-reference/v1/post-image-generate)      |                        <span class="tag tag-image">image</span>                        | Product data extraction system that processes product images to extract structured information including visual description, product details, and delivery information.              |
| [retail.product-catalog](/api-reference/v1/post-image-generate)                |                        <span class="tag tag-image">image</span>                        | Gain a competitive edge with real-time analytics from product catalog, helping you track trending topics, public sentiment, and influential quotes that shape audience perspectives. |