What a video prompt has to settle
A video model fills every gap you leave, and a few seconds of footage has a lot of them. If you don't decide what moves, where the camera goes and what happens first, the model decides at random, and differently each run. Six things close most of the gaps:
- The opening picture. Subject, place and time of day, written like a still photo. Everything later grows out of that first frame.
- One action and its pace. Steam drifts, a cat crosses the street, dough folds. Say how fast. «Slowly» is an instruction; «dynamic» isn't.
- One camera move. Locked off, a slow push-in, a pan to the right, a crane rising. Two moves in one short clip usually fight each other.
- Timing. The length in seconds, and the order of events if there's more than one: «for the first three seconds…, then…». Runway's own prompting guide also documents rough timestamps such as [00:01] and [00:03].
- Light and look. Where the light comes from, the palette, and a genre the model knows: a nature documentary, a product ad, a hand-drawn anime.
- Sound, if the tool makes it. One line that names what you hear and what you don't: «Sound: rain on glass, distant traffic, no music».
Put together, a pattern you can type from memory:
[Shot type] of [subject] in [place], [time of day].
[What moves], [how fast]. Then [the one change, if any].
Camera: [one move], smooth.
Light: [direction]. Look: [palette or genre].
Sound: [what you hear], no music.
[Seconds] seconds, [16:9 or 9:16]. No text, no logos, no watermark.
Every block on this page follows that order and closes with a «No…» line against captions, logos and stray signs. The blocks are written silent, so add the sound line yourself when your tool generates audio.
Text-to-video or image-to-video
The two modes need different prompts, and mixing them up is the quickest way to waste a render.
In text-to-video, the words are all the model has. You describe the picture and the motion: subject, setting, light, style, then what moves and what the camera does.
In image-to-video, your picture is the first frame. Runway's image-to-video guide puts it plainly: the image already sets the composition, subject, lighting and style, so the prompt should describe motion. Refer to things in general terms («the woman», «the cup») and spend your words on what moves, the camera and the timing.
The camera [slowly pushes in]. [The subject] [one action].
[What else moves in the scene]. Everything else stays as it is.
Two things about the source image matter more than the prompt. Blurry hands, warped faces and other flaws tend to get worse once the frame moves, so fix them first. And an image can carry implied motion, such as motion blur, a mid-stride pose or flying dust, which pulls the clip in that direction whatever you write. The Animate A Still Photo block is written for this mode and allows only motion that already belongs in the picture.
Which prompt for which clip
Pick by what the clip is for, then fill the brackets.
| You need | Use | What the clip does |
| Motion added to a photo you already have | Animate A Still Photo | Breeze, water and clouds, a slow push-in, the face untouched |
| Footage to cut under a voiceover | Talking Head B Roll | A static desk shot with steam and light, nobody in frame |
| Hands-at-work detail | Bakery Hands B Roll | Top-down kneading with flour dust, no faces |
| A vertical product ad | Coffee Pour Ad Clip | Five seconds of slow-motion pour, backlit, 9:16 |
| A social background with room for text | Falling Petals Social Loop | Petals falling in a seamless 9:16 loop |
| A slide background | Abstract Presentation Loop | A dark gradient loop for white text on top |
| A cinematic landscape | Forest Fog Cinematic Shot | One crane move up through fog, no cuts |
| A change inside one take | Weather Transition Clip | Sun, then cloud shadow, then rain over a field |
| A sports moment | Slow Motion Sports Clip | A side tracking shot at high frame rate, face turned away |
| A property or interior tour | Architecture Walkthrough Clip | A gimbal move from hallway to window |
| A handmade look | Stop Motion Desk Scene | Desk objects moving in stepped frames |
| An animated scene | Anime Style Street Scene | A painted street after rain, a slow pan |
A weak prompt, written as a shot
This is the kind of request that gets typed into a video tool first:
Cozy bakery at sunrise, cinematic, aesthetic, 4K, trending.
It names a place and a mood and nothing that happens. Here's the same idea as a shot. We wrote it for this page to show the shape; it isn't output from any model:
Static wide shot of a small corner bakery seen from across an empty
street at dawn, blue light, wet cobblestones. For the first three
seconds nothing moves except a pigeon on the curb. Then the lights
inside the bakery switch on, one row at a time, and warm light spills
onto the pavement. The camera begins a slow push-in toward the window
and stops at the glass. Warm amber inside, cool blue outside, slight
film grain. Sound: quiet street ambience, one bird, the soft click of
the lights, no music. 8 seconds, 16:9. No people, no readable signage,
no text, no watermark.
Three changes carry it. The clip now has an event, the lights coming on, so the eight seconds have a beginning and an end. The timing is spelled out, and the camera only starts moving after the event, so two things never compete for the same second. And the sound line says what to hear and rules out music. Drop it in a tool that makes no audio.
Lines that fix a clip
Run the same prompt two or three times before you change it, since results vary a lot between runs. If the same fault keeps coming back, add the line on the right.
| The clip | Add or change |
| Moves the camera when you wanted it still | The locked-off camera stays perfectly still for the whole clip. |
| Cuts to a new shot halfway | One continuous, seamless shot with no cuts. Then try a longer duration. |
| Starts the action too late | In the first two seconds, [the action] begins. |
| Sets everything moving | Only [the steam] moves. Everything else stays still. |
| Comes with music you didn't want | Sound: only [room tone and rain]. No music, no voices. |
| Ignores your motion in image-to-video | Check the photo for blur or mid-action poses, or start from a calmer frame. |
| Jumps when it loops | The last frame matches the first exactly, so it repeats without a cut. |
| Changes a face in an animated photo | Keep the face exactly as photographed. Motion only in hair, fabric and background. |
Where AI video goes wrong
The weak spots are shared across tools, and writing around them saves renders.
- Motion you didn't ask for. Video models are built to move things. A prompt that only describes a scene often gets a drifting camera or a sudden zoom. Say what moves, and say what stays still.
- Too many beats for the length. Three events in five seconds come out rushed and half-finished. Give each event two or three seconds, or make two clips and join them.
- Contact. Pouring, gripping and anything where two objects touch can melt or pass through each other. That's why several blocks here say «no hands».
- Words on screen. Signs, labels and titles come out garbled. Add text in an editor, where you can spell it.
- Speech. Tools that make dialogue can still miss lip movement or mangle a line. If you don't need a voice, write «no one speaks».
- Real people. Our text-to-video blocks keep faces out of frame or turned away, and none names a real person. Don't use these tools to put words or actions on someone who exists; Google's Gemini help page, for one, bars using its video feature to deceive, harass or harm others.
What the current tools take, as of October 2026
From each vendor's own documentation. These change often, so check your tool's controls before writing a length into the prompt.
| Model | Clip length | Sound | From an image |
| Veo 3.1 (Google) | 4, 6 or 8 seconds; 1080p and 4K only at 8 | Always on: dialogue, effects, ambience | First frame, first and last frame, up to three reference images |
| Gemini Omni Flash (Google) | 3 to 10 seconds | Generated from your description | Yes, plus editing a clip by describing the change |
| Kling VIDEO 3.0 | 3 to 15 seconds | Native, with dialogue in Chinese, English, Japanese, Korean and Spanish | Start and end frames, multi-shot scenes |
| Seedance 2.5 (ByteDance) | 4 to 30 seconds, up to 1080p in the API | Generated with the video, dialogue in 11 languages including English and Spanish | First and last frame, plus up to 30 reference images, 10 videos and 10 audio clips |
| Runway Gen-4.5 | 2 to 10 seconds, 720p, 24 or 25 fps | Not listed on its spec page | Yes; text-to-video is 16:9 only, image-to-video has six ratios |
What that changes in the prompt: Google's Veo documentation asks for dialogue in quotation marks and for sound effects and ambience described outright, so write «Sound: …» as its own sentence. Gemini Omni Flash, which Google's help center says now makes video in the Gemini app, edits a finished clip from a short instruction. Keep those edits brief and add «keep everything else the same». Kling's 15 seconds fit a sequence of beats; the other tools here want one or two, except Seedance 2.5, which runs to 30. Runway's Gen-4.5 needs the Standard plan or higher, and its duration and frame rate are set in the controls, so delete those words from the prompt there. Our reviews of Google Flow, Kling, Runway, Luma and Pika cover prices, and the AI video generators page compares them. If you're coming from Sora, which OpenAI has shut down, the Sora prompts page keeps more shot types in the same shape, ready to paste into any of these.
Seedance 2.5 prompts
ByteDance's Seedance 2.5, in Dreamina and through the BytePlus API, takes the longest clips of the tools above and reads more structure than the rest. Its own prompt guide asks for a one-sentence summary first, then the plot as a timeline in whole seconds with no gaps, or as numbered shots with «Hard cut» between them. Reference files are named in the text by upload order, @Image1, @Video1, @Audio1, and each one needs a line saying what it's for. Write spoken lines as a character's line with the language before it and an emotion in parentheses, and only two negatives are supported: «no subtitles» and «no music» or «no audio». It won't take uploads of real people's faces. Five prompts written to that guide: a 30-second one-take story, a multi-shot product ad, a character kept consistent from reference images, a dialogue scene with lip sync and extending a clip you already have.
The sentences stay, the settings move. Duration and ratio are typed into the prompt in some tools and chosen from a control in others, so delete those words when the interface owns them. Animating an uploaded still sometimes lives on its own tab. What carries everywhere is the order these blocks follow: subject, what moves, what the camera does, then the light.
That is what Animate A Still Photo is for. You attach the picture, and the wording allows only motion that already belongs in it, such as hair lifting in a breeze, clouds drifting or water rippling, plus a push in of a few percent. It also forbids new objects and any morphing of the face, which is the failure this mode is most prone to.
Hold the frame still, keep people out of it, and let one small thing move. Bakery Hands B Roll and Talking Head B Roll both use a locked tripod, shallow focus and a single slow action at six seconds, long enough to cut into and short enough to stay clean. Keep colour neutral so it matches your own footage, and mute any audio the model attaches.
Coherence decays as a generation runs, and the more elements you set moving, the faster it goes. Limit yourself to one action, keep the background simple, and ask for a static or slow camera so the model is not inventing scenery as it travels. Then cut before the drift: using the first four usable seconds of a six second render is normal practice.