参考生视频:让 AI 角色和场景保持一致
用图像参考而不是更长的提示词,让 AI 视频中的角色和场景在镜头之间保持一致。然后在同一场戏上比较两条 ScreenWeaver 管线。
在这一课中你将学到
- 为什么光靠文字描述,无法让一张脸在两次生成之间保持一致
- 四种模式:文生视频、图生视频、参考生视频,以及首尾帧
- 一个镜头需要哪些参考图,以及什么才是干净的参考图
- 如何在提示词中把每张参考图绑定到它的任务上
- ScreenWeaver 的 Reference to video 和 Storyboard panels to video 两条管线如何运作,以及各自适用的场合
- 如何用首帧和尾帧保持片段之间的连戏
- 破坏镜头的四个参考图陷阱
光靠文字留不住一张脸:即使把一个角色描述得再完美,两次生成仍然会给你两个不同的人。这一课教你如何用图像参考,让 AI 视频中的角色、场景和道具保持一致。你会学到用图像驱动视频模型的四种方式,从文生视频到首尾帧,什么才是干净的参考图,以及如何在提示词中把每张图绑定到它的任务上。然后你会看到 ScreenWeaver 的两条管线。Reference to video 让一个 Prompt director 根据你的镜头动作为整场戏写一份简报,制作设定图会被自动绑定。Storyboard panels to video 把最多 14 格分镜拼成一张网格,让模型遵循你的构图。The Photo 的同一场戏会用两种方式分别生成,并排对比。最后你会学到用首帧和尾帧保持连戏,以及破坏基于参考图的镜头的四个陷阱。
完整文字稿
英语旁白的文字稿。
0:04Text alone can't hold a face. You can describe Amelie in perfect detail and two generations will still give you two different women. References are what turn a description into a specific person, a specific car, a specific photograph. In this lecture, you'll learn the four ways to drive a video model with images and how Screenweaver's two pipelines use them.
0:30Four modes, from loosest to tightest. Text to video. Words only, maximum freedom, minimum consistency. Image to video. One start image and the model animates it. Reference to video. Several images that define who and what appears while the model stages the shot itself. And first and last frame. You give the start and the end and the model finds the way between them. The more images you give, the more you control and the less the model invents.
1:02What should you give as references? For each character in the shot, their production sheet. For the location, one clean image of the set. For key props, a sheet of the object alone. And the art direction image for the overall look. Keep it to what the shot needs. Every extra reference competes for the model's attention.
1:23Quality matters more than quantity. A reference should be sharp, evenly lit and show the subject clearly with nothing that competes. No busy background, no second person, no text. A blurry or cluttered reference gives you a blurry, cluttered character.
1:41Then bind each reference to its job in the prompt. Our real prompt starts with a line of asset bindings. Thomas's car is image one. The photograph is image two. Then the text says, the vehicle interior and ambient lighting of image one and image two governing the prop's physical structure and the print on it. Name it and give it a job.
2:05In Screenweaver, the first pipeline is called reference to video. It takes the action of each shot. A prompt director writes one brief for the whole scene and a scene video node generates one clip. The characters, places and objects you mention in your shot actions are resolved into their production sheets and bound to the prompt automatically. Note what it doesn't use, your storyboard panels. The model stages the scene from your words and your references.
2:35The second pipeline is storyboard panels to video. It assembles your storyboard panels into a single grid image, up to 14 panels and sends it to the scene video node together with your art direction text and image and the grid tells the model the order and the composition of the shots. Never the look. The look comes from the art direction and the sheets.
3:00So which one should you use? Reference to video when you want the model to stage freely from your actions. Storyboard panels to video when your framing has to be respected shot by shot. Here's the photo generated both ways. On the left, reference to video. On the right, storyboard panels to video. Same story, same actors. Look at how the framing follows the previous on the right.
3:29In practice, I often start with reference to video to see how the model stages the scene on its own. If the staging works, I keep it. If the framing drifts away from what I designed, I switch to storyboard panels to video and the grid pulls the camera back to my previous.
3:45First and last frames are your tool for continuity between clips. Take the last frame of one clip and use it as the first frame of the next. The second clip starts exactly where the first one ended. Same pose, same light, same position. It's the cleanest way to continue an action across a cut or to extend a moment that needs more time than one generation allows.
4:09Start frames also let you control exactly where an action begins. Give the model a first frame where Thomas is already turned toward Emily. Then it won't spend two seconds of your clip turning.
4:21Watch out for four traps. A reference that contains a set, like our photograph shot on the back seat, which moved Emily into the back. Two references that contradict each other, like a sheet with a beige coat and a mood board image with a red one. Too many references for one shot and photorealistic faces on models that filter them. When a reference -based shot fails, check the references before you touch the prompt.
4:50Your exercise. For one scene, list the references each shot needs and write the bindings. Which image governs what? Then generate the scene with both pipelines and compare. In the next lecture, we'll deal with the shots that still go wrong and how to fix them without starting over.