RepoDaily · 2026-07-01 · Design / Creative app

video-use: Drop Footage in a Folder, Get final.mp4 From a Chat With Claude Code

#8 Design / Creative app Python +722 browser-use/video-use Open repository

An open-source Python skill that turns coding agents like Claude Code into video editors — cutting filler, color-grading, burning subtitles, and rendering overlays without a timeline UI.

Repo typeDesign / Creative app
Best forSolo creators and developer teams who already live in a coding-agent workflow and want to edit raw footage through natural-language chat instead of a NLE timeline.
Risk levelMedium — early v0.1.0 skill requiring an ElevenLabs API key, ffmpeg, and a compatible agent runtime.
Time to evaluate30–60 minutes for a first render: clone repo, uv sync, install ffmpeg, paste setup prompt into Claude Code, drop footage into a folder.

Primary question: Is your editing bottleneck centered on repetitive cuts and assembly rather than precise visual effects work that a GUI NLE handles better?

91/100

RepoDaily adoption score

RepoDaily rates this as 91/100 (strong) for adoption: evidence, installation path, production risk, differentiation, license clarity, and AI/agent fit are scored from the article sources and adoption notes.

Directional score from RepoDaily sources and adoption notes, not a benchmark.Risk: Medium
100Evidence quality

4 source(s) across 4 source category/categories, plus a RepoDaily-specific evidence module when available.

100Installability

6 workflow step(s), 6 next-action step(s), and 6 command/install signal(s) were detected.

66Maintenance confidence

Trending momentum is +722 stars, with maintenance/release/issue signals counted when present.

90Production readiness

Risk is marked medium, with 4 security note(s) and 4 explicit skip condition(s).

100Differentiation

3 opportunity lens item(s), 4 alternative(s), and 3 type-specific section(s) support differentiation.

82License clarity

License source or license wording is present.

90Agent / AI fit

7 AI/agent-related signal(s) were detected in the article text and metadata.

Project overview

video-use is a conversation-driven video editor skill built by Browser Use, the same organization behind the browser-use web-agent project. Instead of opening DaVinci Resolve or Premiere, you point a coding agent at a folder of raw takes, type a sentence like "edit these into a launch video," and the agent inventories the sources, proposes a strategy, waits for your OK, then renders a final.mp4 next to your clips. The project ships as a Python package with a skill-definition layer (SKILL.md) that Claude Code, Codex, Hermes, and Openclaw can register and call.

The core design choice is that the LLM never actually watches video. It reads a text representation of it. Each source file is transcribed once via ElevenLabs Scribe — producing word-level timestamps, speaker diarization, and audio events like (laughter) or (applause) — then packed into a single ~12 KB takes_packed.md file. That markdown file becomes the model's primary reading view, giving it enough structured data to decide cut points with word-boundary precision.

The skill automates the tedious parts of rough editing: removing filler words (umm, uh, false starts), trimming dead space between takes, applying consistent color grades via configurable ffmpeg chains, inserting 30 ms audio fades at every cut to avoid pops, and burning subtitles in customizable styles. It also spawns parallel sub-agents to generate animation overlays through HyperFrames, Remotion, Manim, or PIL, then self-evaluates the rendered output at each cut boundary before presenting results. Session memory persists in project.md so follow-up sessions resume without re-reading everything.

Problem it solves

  • Traditional NLEs impose steep UI overhead for simple talking-head, tutorial, or interview edits where 80% of the work is removing filler and dead air.
  • Recreating consistent cut fades, subtitle styles, and color grades across sessions is manual and error-prone in GUI tools.
  • Context loss: returning to a project a week later usually means re-watching footage to remember where you left off.
  • Generating animation overlays alongside a cut typically requires a separate render pipeline and manual re-integration.

How it works

  1. Clone the repo and symlink it into your agent's skills directory (e.g., ~/.claude/skills/video-use).
  2. Run uv sync or pip install -e . to install Python dependencies, then brew install ffmpeg for the required media backend (yt-dlp optional for downloading online sources).
  3. Add your ElevenLabs API key to .env by copying .env.example and editing the ELEVENLABS_API_KEY line.
  4. Paste the provided setup prompt into your agent; it reads install.md, wires up ffmpeg, registers the skill, and prompts you for the API key.
  5. Point the agent at a folder of raw footage and type a natural-language instruction like "edit these into a launch video."
  6. The agent transcribes each source via ElevenLabs Scribe, packs all takes into takes_packed.md (~12 KB), proposes a cut strategy, waits for approval, then renders edit/final.mp4.

Concrete Try-It Path

  • Clone: git clone https://github.com/browser-use/video-use ~/Developer/video-use
  • Symlink: ln -sfn ~/Developer/video-use ~/.claude/skills/video-use (or ~/.codex/skills/video-use for Codex)
  • Install deps: cd ~/Developer/video-use && uv sync (alternative: pip install -e .)
  • Install ffmpeg: brew install ffmpeg (required). Optional: brew install yt-dlp for downloading online sources.
  • Configure key: cp .env.example .env, then set ELEVENLABS_API_KEY (obtain at elevenlabs.io/app/settings/api-keys).
  • Run: cd /path/to/your/videos && claude, then type your editing instruction in-session.
  • Output appears at <videos_dir>/edit/final.mp4; the skill directory stays clean.

Integration Surface

video-use is agent-runtime agnostic — the README explicitly names Claude Code, Codex, Hermes, and Openclaw as compatible runtimes. It depends on ElevenLabs Scribe for word-level transcription with speaker diarization and audio-event detection. ffmpeg is the required media backend for cutting, fading, and color grading. Animation overlays can be generated through HyperFrames, Remotion, Manim, or PIL, each spawned as a parallel sub-agent. For always-on editing, Browser Use Box (browser-use.com/bux) wraps the skill so it can run from a VPS or respond through Telegram.

Deployment Notes

Python >=3.10 is required (per pyproject.toml). Core runtime dependencies are requests, librosa, matplotlib, pillow, and numpy. Manim is an optional dependency under [project.optional-dependencies] named animations. The project uses setuptools as its build backend (requires setuptools>=61.0). Outputs are isolated in <videos_dir>/edit/, keeping the skill directory clean. Session state persists in project.md at the project root.

Who should pay attention?

Good fit if

  • You already use Claude Code or another coding agent daily and have shell-based workflows.
  • Your content is dialogue-heavy: talking heads, interviews, tutorials, podcasts, or vlogs where cutting filler and dead air is the main task.
  • You want repeatable subtitle styles and color grades without manually re-configuring a GUI NLE each session.
  • You need to return to projects across sessions and want the agent to remember prior decisions via project.md.

Skip for now if

  • You need frame-precise visual effects, multi-track compositing, or advanced audio mixing that a timeline NLE handles natively.
  • You do not have or cannot obtain an ElevenLabs API key (Scribe is the transcription backbone).
  • You are on Windows without ffmpeg or a Unix-friendly skills directory structure.
  • Your footage requires heavy motion graphics or 3D work beyond what Remotion, Manim, PIL, or HyperFrames templates can express.

Risks and cautions

Medium

The project is at v0.1.0 with a narrow dependency surface (Python 3.10+, ffmpeg, ElevenLabs API key) but depends on a paid external API and assumes comfort with coding-agent runtimes.

  • Version 0.1.0 in pyproject.toml signals pre-1.0 maturity; APIs and skill-format expectations may change.
  • Requires a paid ElevenLabs Scribe API key for every transcription; cost scales with source duration and session count.
  • Agent-runtime compatibility depends on the skill format each tool supports; Claude Code is the primary tested target.
  • ffmpeg must be installed separately (brew install ffmpeg), adding a system-level prerequisite outside Python packaging.
  • API key stored in a local .env file copied from .env.example — verify .env is in .gitignore before pushing any fork.
  • The agent has shell access by design (uv sync, pip install, ffmpeg invocations) — run in an isolated user account or container.
  • No network sandboxing layer documented; the skill calls ElevenLabs endpoints and may fetch online sources via yt-dlp.
  • MIT License (Copyright 2026 Browser Use) permits commercial use, modification, and redistribution with no warranty.

Alternatives to compare

ApproachWhen to useTrade-off
You want to build programmatic video and animation overlays in React with full code control rather than editing existing footage.Free for individuals; paid company license above threshold.
Manim
You focus on mathematical or educational animation rendering rather than cutting raw footage.Free, MIT-licensed.
You want HeyGen's animation-overlay pipeline integrated as a sub-agent target.Check repository for current licensing.
Adobe Premiere Pro / DaVinci Resolve
You need a full timeline NLE with multi-track compositing, color grading panels, and audio mixing.Commercial subscription or one-time license.

What this trend reveals

Internal podcast post-production pipeline

Wire video-use into a CI-style automation that pulls raw episode recordings from object storage, runs the skill headlessly through Browser Use Box, and publishes edit/final.mp4 to a CDN with burned-in subtitles.

Record a 10-minute test episode, run the skill locally, measure transcription cost via ElevenLabs Scribe, and confirm the cut quality meets your editorial standard before automating.

Multi-language subtitle workflow

Because takes_packed.md contains word-level timestamps and speaker labels, you can extend the helpers/ scripts to translate segments and burn localized subtitle tracks without changing the core cutting logic.

Fork the repo, add a translation step after transcription, and render a second final.mp4 with translated subtitles for one sample clip.

Tutorial and course assembly service

For educators producing talking-head tutorials, the skill's filler-word removal and 30 ms cut fades handle the bulk of assembly work. Layer a custom ffmpeg chain for brand-consistent color grading.

Process three existing raw tutorials end-to-end, compare total editing time against your current NLE workflow, and confirm the output meets your publication bar.

Best next action

Run a 10-minute single-source test render

The fastest way to judge whether video-use fits your pipeline is to run one real clip through the full cycle: setup, transcribe, propose cuts, approve, and render.

  1. Clone the repo into ~/Developer/video-use and symlink it to ~/.claude/skills/video-use.
  2. Run uv sync and brew install ffmpeg.
  3. Copy .env.example to .env and paste your ElevenLabs API key.
  4. Place one 5–10 minute raw clip in an empty folder.
  5. Open Claude Code in that folder and type: edit this into a short, clean cut.
  6. Review edit/final.mp4 for filler removal, cut-fade smoothness, and subtitle accuracy.

RepoDaily verdict

video-use applies the coding-agent skill pattern to a genuinely painful creative task. The design — read video as a ~12 KB markdown transcript, cut with word-boundary precision, self-evaluate at boundaries — is concrete and well-scoped. At v0.1.0 with an ElevenLabs API dependency it is not a production NLE replacement, but for solo creators and developer teams already comfortable with Claude Code, it can meaningfully compress rough-edit time on dialogue-heavy footage.

Sources