Turn Your Storyboard Into Cinematic AI Video
The quality of AI video is decided before the video model. A strong frame, one clear action and a controlled camera instruction outperform a complicated prompt almost every time.
Chapters (35)
Lesson notes
Where this step stood when the lesson was recorded
When this lesson was recorded in August 2026, ScreenWeaver's Production stage was on its way but not live yet. The workspace took you to the edge of video: a directed storyboard, a frame and a written instruction for every shot, timings, and continuity that holds. The clips themselves were generated in a separate video tool, and the lesson says so plainly.
That is less of a compromise than it sounds. What makes AI video work or fail is almost never the model. It is the quality of what you hand it.
Six checks before you generate any video
- 1Source image: is the frame good enough to move? A video model does not fix a bad frame, it animates it. A wrong hand in the still is a wrong hand in motion.
- 2Character: does she match her reference sheet? Drift in the still drifts further once it moves.
- 3Action: one moment.
- 4Camera movement: one move.
- 5Duration: shot five's card is 4 seconds.
- 6Aspect ratio: 2.39:1, like every other shot, because it was set before generating.
Each shot is a small graph: action, shot value and camera movement feed the storyboard panel, and the panel holds the prompt actually sent, including a long block on absolute character consistency (same face shape, same proportions, same clothing; do not redesign, beautify or reinterpret). It is a managed prompt: you do not handwrite it, you change the three things it is built from. Less freedom, much more consistency.
Why complex video prompts fail
Mara listens to the radio as the voice comes through. She looks shocked and turns towards the door while the camera moves around her dramatically and the lights flicker.
Count the events: she listens, the voice arrives, she reacts, she turns, the camera orbits, the lights flicker. Six events in four seconds. Given six instructions, a model does not choose one. It attempts all of them badly: a face mid-reaction the whole time, a turn that never completes, a wandering camera.
Mara stands very still, seen from behind her right shoulder. Her head tilts 2 cm towards the speaker grill. Camera pushes in slowly. Dust drifts in the light from the window. Nothing else moves.
- One main action, and a tiny one: small movements generate beautifully, large ones fall apart.
- A physical performance, not an emotion. "She looks shocked" is an interpretation; a 2 cm tilt is an instruction.
- One camera move, described plainly.
- Environmental motion: dust, steam, rain on glass, a curtain, water. A still subject in moving air reads as alive without risking your character.
- A boundary: "Nothing else moves" does more work than the rest of the sentence.
Time the action inside the shot
Clips have a fixed length. Whatever the duration, the main action should be finished about two thirds of the way through. A 4-second shot where the movement completes at 3 seconds feels calm; one still moving at 4 seconds feels cut off. So say it: "The turn completes in the first 2 seconds, then she is still." When the story needs something big, a run, a fall, a door opening, give it more time or fewer things to do.
A real failure, and fixing one shot
The lesson keeps a real failure: around the second second Mara's left hand comes apart, and the camera swings instead of pushing in. Both causes were the instruction's: the move was too big for 4 seconds, and the hand was already the weakest part of the source frame.
Mara stands very still. Seen from behind her right shoulder. Her head tilts slightly towards the speaker grill. Camera pushes in very slightly, about 10 cm at constant speed. Her hands stay out of frame. Dust drifts in the window light. Nothing else moves.
"Her hands stay out of frame" is not a defeat: directors shoot around props that will not read. And only that shot was regenerated. When one shot fails, fix that shot. The other nine were fine.
The six common AI video failures
- 1Too much camera movement (swings, drift, sliding frame): make the move smaller or the shot longer, never both at once, or you will not know which worked.
- 2Unclear action: you described a state, not an event. "She is nervous" is a state; "her thumb taps the edge of the desk twice" is an event with a beginning and an end.
- 3Deformation of hands, faces, hair: shrink the movement, and if a body part keeps failing, take it out of frame. A close-up on the handset often beats a wide shot with broken hands.
- 4Performance that does not match its neighbours: write adjacent instructions together and make the end state of one the start state of the next.
- 5Conflicting instructions (stillness and drama, static camera and a push in): count the verbs and delete the one that fights.
- 6Too much action for the duration (turns, walks and sits in 3 seconds): a shot design problem, not a prompt problem. Cut it into two shots.
When a shot matters, generate several takes and compare them side by side, then keep the winner and move on. The project's generation history lists every generation it has run; failed jobs appear in red with error details and a retry option. Check it after a heavy session to learn which shots give you trouble.
Protect continuity, then assemble
- Character appearance: the reference sheet is the contract. Compare one last time before sending a shot to video.
- Lighting: one source, the window on Mara's right, in every shot.
- Screen direction: she stays on the left of frame looking right.
- Eyelines: she looks right in shot seven, so the door is on the right in shot eight.
- Environment: same salt, same rust, same weather in the window.
- Movement between shots: if she is turning at the end of one clip, she is further into the turn at the start of the next. The model does not know your previous clip. You do.
Time it all on the sequencer first: your durations are what you ask the video model for, and a shot that feels long as a still feels unbearable as a clip. Export the script as PDF (optionally with the outline), FDX or a Screenwriter backup, and save frames named by shot number (SIGNAL_S01, SIGNAL_S02). Ten frames, ten instructions, ten durations, in order: a shooting package anyone can generate from without asking you a question.
Then the edit is assembly, not archaeology. You are not discovering your film among 40 clips; you lay ten clips in the order the sequencer already decided. When one disappoints, fix that shot, drop the new clip into the same slot and carry on. Never restart a sequence for one shot.
Try this step in ScreenWeaver
Build your shooting package
Take your directed storyboard, run the six checks on each frame, and write one clear instruction per shot before you generate any video.
Prepare your shotsGo further
Film techniques in this lesson
Free tools
- AI Video Prompt Generator
Build cinematic prompts for Veo, Sora, Runway, and Kling.
- AI Video Model Picker
Filter every major AI video model by what your shot needs.
- AI Video Cost Calculator
Estimate what an AI-generated film really costs, retries included.
- Scene to Clip Splitter
Split a scene into AI video clips that fit your model's duration cap.
- Video Frames Calculator
Convert frames, FPS, and duration for AI video workflows.
Guides
- How to make an AI film
The full script, storyboard and production workflow on one page.
- AI storyboard generator
Turn screenplay scenes into a shot list and storyboard frames.
- Film techniques
Every shot size, angle and camera move, each with a demo clip and its prompt.
The full course
- 1How to Make a Film With AI: Script to Storyboard Workflow7 min
- 2AI Screenwriting: From Idea to Screenplay (or Import Yours)15 min
- 3Improve Your Screenplay With AI (Without Letting AI Write It)11 min
- 4How to Keep AI Characters Consistent Across Every Shot13 min
- 5How to Storyboard a Film With AI - Step by Step16 min
- 6Stop Making Flat AI Shots: Direct Them Like a Film12 min
- 7Turn Your Storyboard Into Cinematic AI Video18 min