Edit & Enhance

​

Key Features

• Object Removal & Addition: Seamlessly remove unwanted objects or add new elements
• Background Replacement: Change or enhance backgrounds with realistic results
• Color Correction & Enhancement: Adjust colors, contrast, and lighting automatically
• Noise Reduction & Upscaling: Improve video quality and increase resolution
• Smart Retouching: AI-powered enhancement and correction
• Batch Processing: Apply edits to multiple videos simultaneously

​

Response Format

{
  "edited_video_url": "https://api.vlmrun.com/edited/edit_12345.mp4",
  "original_video_url": "https://api.vlmrun.com/original/orig_12345.mp4",
  "edit_type": "object_removal",
  "applied_edits": [
    {
      "type": "object_removal",
      "target": "cars",
      "confidence": 0.94,
      "frames_processed": 900
    }
  ],
  "quality_metrics": {
    "sharpness": 0.89,
    "color_accuracy": 0.92,
    "temporal_consistency": 0.91,
    "overall_quality": 0.91
  },
  "processing_time": "8m 30s"
}

​

Editing Types

​

Object Removal

• Smart Detection: Automatically identify objects to remove across frames
• Temporal Consistency: Maintain consistent removal throughout video
• Context-Aware: Fill removed areas with appropriate background content
• Multiple Objects: Remove several objects in a single operation

​

Background Replacement

• Precise Masking: Accurate subject separation from background
• Natural Blending: Realistic integration with new backgrounds
• Edge Refinement: Smooth, natural-looking edges
• Lighting Matching: Adjust lighting to match new background

​

Color Enhancement

• Automatic Correction: AI-powered color and exposure correction
• Manual Adjustments: Fine-tune brightness, contrast, saturation
• Style Transfer: Apply color grading and artistic styles
• Frame Consistency: Maintain consistent color across all frames

​

Noise Reduction & Upscaling

• AI Upscaling: Increase resolution while maintaining quality
• Noise Reduction: Remove grain and artifacts from videos
• Detail Enhancement: Improve sharpness and clarity
• Super Resolution: Generate high-resolution versions from low-res videos

​

Smart Retouching

• Skin Smoothing: Natural-looking skin enhancement
• Blemish Removal: Remove spots, wrinkles, and imperfections
• Eye Enhancement: Brighten and enhance eyes
• Teeth Whitening: Natural teeth whitening and enhancement

​

Video Stabilization

• Camera Shake Reduction: Smooth out shaky camera movements
• Subject Stabilization: Keep tracked subjects stable in frame
• Smooth Transitions: Ensure smooth movement throughout video
• Quality Preservation: Maintain video quality during stabilization

​

Advanced Features

​

Batch Processing

• Multiple Videos: Process several videos with the same edits
• Consistent Results: Apply uniform adjustments across a set
• Efficient Processing: Optimized for large video collections
• Progress Tracking: Monitor batch processing status

​

Custom Masks

• Precise Control: Define exact areas for editing
• Complex Shapes: Support for detailed mask shapes
• Feathered Edges: Smooth transitions between edited and original areas
• Multiple Masks: Apply different edits to different areas

​

Style Transfer

• Artistic Styles: Apply painting and artistic effects
• Photographic Styles: Mimic specific camera or film looks
• Custom Styles: Use your own reference videos
• Intensity Control: Adjust the strength of style application

​

Temporal Editing

• Speed Control: Change video playback speed
• Time Manipulation: Reverse, loop, or reorder video segments
• Transition Effects: Add smooth transitions between scenes
• Duration Adjustment: Extend or shorten video content

​

Quality Settings

​

Ultra Quality

• Maximum Detail: Highest possible video quality
• Advanced Processing: Uses most sophisticated algorithms
• Longer Processing: Takes more time for best results
• Professional Use: Ideal for commercial and professional applications

​

High Quality

• Excellent Results: Very high quality with good processing speed
• Balanced Performance: Good quality-to-speed ratio
• Most Use Cases: Suitable for most professional applications
• Recommended: Best overall choice for most users

​

Medium Quality

• Good Results: Solid quality with faster processing
• Efficient Processing: Good balance of quality and speed
• Web Use: Suitable for online and social media use
• Batch Processing: Good for processing multiple videos

​

Execute Agent

from pathlib import Path
from vlmrun.client import VLMRun

client = VLMRun(base_url="https://agent.vlm.run/v1", api_key="<VLMRUN_API_KEY>")

# Upload the video
file = client.files.upload(file=Path("original_video.mp4"))

# Execute video editing
response = client.agent.execute(
    inputs={"file": file.public_url},
    config={
        "prompt": "Remove all cars from this video and enhance the background",
        "capability": "video_editing",
        "edit_type": "object_removal",
        "target_objects": ["car"],
        "enhance_quality": True
    }
)

# Poll for results
import time
while True:
    execution = client.agent.executions.get(execution_id=response.execution_id)
    if execution.status == "completed":
        print(execution.response)
        break
    elif execution.status == "failed":
        print(f"Error: {execution.error}")
        break
    time.sleep(2)

​

Best Practices

• High-Quality Source: Start with the best possible source videos
• Specific Prompts: Be clear about what you want to edit
• Iterative Approach: Make multiple small edits rather than one large change
• Preview Results: Check results before finalizing edits
• Temporal Consistency: Ensure edits maintain consistency across frames