Insights
How to turn Claude into your video editor
Claude reads your transcript, picks the cuts, and writes the edit list. You run the render. Here is the workflow, prompts included, plain English.
Short answer: stop opening an editing app. Write down your editing rules once, give them to Claude, then drop raw footage into a watched folder and let it cut, caption, brand and render the finished reel. The rules are the hard part, not the software, and they are what make it edit like you.
I do not open an editing app any more. I film on my phone, drop the file into a folder, and a finished, branded reel appears in another folder a while later. Cut, captioned, with graphics, sound effects and a cover image ready for Instagram.
No editor. No timeline. No render queue I have to babysit.
Here is how it works, what you need to set it up, and the part most people miss: how to make it edit like you, not like a template.
Part 1: What this actually is
The system is Claude Code, running on your own computer, with a few free tools it drives on your behalf:
- Whisper turns your speech into text, so the edit can be made from what you actually said.
- ffmpeg does the cutting, joining and mixing. It is the engine underneath most video software.
- A renderer turns web pages into video, which is how the captions and graphics get drawn in your brand.
You drop a raw clip into a watched folder. Claude transcribes it, cuts the pauses and the fluffed lines, writes captions, builds the graphics, mixes in sound effects, picks a cover frame and outputs the finished file. The only thing I do is film and approve.
Two things worth being clear about, because they are where most setups go wrong:
One: nothing here uses an AI video editing app. No subscription editor, no AI b-roll generator. Every graphic is drawn in my brand by code. I made that choice deliberately: AI-generated footage of "someone like me" is obvious, and it ages badly.
Two: the value is not the install. The tools take an afternoon. What makes the output good is the rulebook you build over the following weeks, which I cover in Part 3.
Part 2: The setup, step by step
Install the Claude desktop app, then open a new empty folder in it. From there you are just talking to Claude. Give it these instructions, in this order, and approve the commands it asks to run.
Step 1: Install the toolchain
"Install the video editing toolchain: ffmpeg, Whisper, Node 22, and the HyperFrames renderer. Then check each one is working."
Step 2: Create the folder structure
"Set up these folders: a raw folder for clips to edit, an outputs folder for finished videos, an assets folder with fonts and logos, and a working folder for the build files."
Step 3: Add your brand
"Here are my brand colours, fonts and logo. Turn them into a brand file you will follow for every video."
If you have a brand PDF or a website, hand that over and let Claude write the file.
Step 4: The cutting rule (do not skip this)
"When you cut, find where I am actually speaking from the audio itself, and only ever cut in real silence between words. Never cut using transcript timings. After every cut, check the result and confirm no word was clipped."
This one matters more than anything else in the setup. Speech-to-text timings drift by up to a second and will happily put words in the wrong place. Cut by those timings and you will chop words in half without noticing. Cut by where the audio is actually loud, and you never do.
Step 5: Your first edit
"Edit this clip into a branded reel following my brand file. Cut the pauses and the mistakes, add captions, and give me a cover image from a real frame."
Step 6: Turn it into a skill
Once a reel comes back the way you want it:
"Take everything we just did and turn it into a skill, so every future video is made this way."
Claude writes the whole process down as a reusable instruction file. From then on, "edit the new video" reproduces it.
Step 7: Make it automatic
"Set up a folder watcher so that whenever a video lands in the raw folder, you edit it automatically and tell me when it is done."
That is the whole install. Everything after this is taste.
Your brand file holds the visual facts: colours, fonts, logo rules, how captions look, the words you never use. Keep it boring and specific. Claude follows it literally, which is exactly what you want.
Your director's notes are the rules you accumulate by reacting to real edits. Mine now include things like:
- Open on my face, never on a graphic. A graphic in the first half second reads as an advert.
- Graphics appear only while something is moving in them, and leave as soon as they settle. Nothing holds still on screen.
- Keep me on camera as much as possible. Graphics punctuate, they do not carry the video.
- Cut every pause. If a sentence has no silence inside it, keep the sentence whole rather than cutting into it.
- No colour grading. Natural camera footage only.
- The cover image is a real frame, chosen for a calm expression with eyes on the lens, never a mid-word grimace.
None of those came from planning. Every one came from watching an edit, disliking something specific, and saying so.
The habit that makes this work: every time you give feedback, finish with "and update the skill so this never happens again." That single sentence is the difference between an assistant you correct forever and a system that gets better every week.
My tenth edit was far better than my first, and I did not touch a timeline for either.
What this replaces
An editor costs money per video and has a turnaround time. This costs your Claude subscription and runs while you do something else. But the honest pitch is not the money. It is that a system you can correct will beat a service you have to brief, because the corrections compound.
Start with one clip. Make it right. Then let it run.
Related reading
The same thinking applied to deciding what to film in the first place is in how to build a content library that never runs dry. For the wider pattern of handing a scheduled job over entirely, see how to automate repeat work with Claude.
If you want help setting this up for your team, have a look at how I work.
