The Keyframe-to-Video Workflow: Consistent AI Shots with i2v

The keyframe-to-video workflow is simple to state. Instead of asking a video model to invent a shot from a text prompt, you generate a still keyframe with a reference-aware image model, attaching your product shots and creator identity images as references. You approve that still, then animate it with an image-to-video (i2v) model. The still becomes a contract that locks composition, identity, props, and framing before a single second of video renders. For brand work, that is the difference between gambling and directing.

Text-to-video impresses on open-ended creative shots. An ad is not open-ended. It needs a specific product with a specific label, a creator whose face matches the last shot, and a composition that leaves room for a text overlay. A text prompt under-specifies all of that, so the model fills the gaps with its own ideas: a different bottle shape, a logo that almost reads correctly, a face that belongs to nobody in particular.

The cost structure makes it worse. A video generation takes anywhere from one to five minutes depending on model and load, and you can’t evaluate it until it finishes. When the failure rate per attempt is high and each attempt is slow and expensive, iteration grinds. You end up re-rolling whole videos to fix problems that were visible in the first frame.

Keyframe-first inverts the economics. Stills render in seconds, cost a fraction of a video, and expose almost every brand-critical failure before you commit to motion: wrong label, wrong face, wrong framing. Cheap rejection is the core idea. Kill bad shots while killing them is still cheap.

• Cheap rejection: a bad still is discarded in seconds for cents; a bad video wastes minutes and a meaningfully larger generation cost.
• Identity anchoring per shot: reference-aware image models accept your product photos and creator images directly, so each keyframe starts from the right face and the right label instead of an approximation.
• Deliberate composition: you choose where the product sits, where the eyeline goes, and where overlay text lands, all at the still stage where changing it is trivial.
• A reviewable artifact: a grid of keyframes is something a human or a vision model can grade in one pass; a folder of half-wrong videos is not.

This is the process our studio runs daily, in the order we run it. It sits inside a larger pipeline of brief, shot plan, and assembly, covered in our AI ad production pipeline post. These are the steps from shot plan to usable clip.

1. 01Lock the references. Collect clean product shots (label readable, neutral background) and creator identity images. These get attached to every keyframe generation, not pasted into the prompt as a description.
2. 02Lock the look constants: one location, one outfit, and a short palette-and-lighting note shared across all shots, so six shots read as one world instead of six.
3. 03Generate keyframe candidates. For each shot in the plan, generate 2–4 stills with a reference-aware image model, references attached, composition described per shot.
4. 04Grade the stills. Check brand fidelity across label, colors, and product geometry, identity match against the creator references, continuity with neighboring shots, and artifacts. Reject and regenerate until one candidate passes. This is the QA gate, and nothing animates without passing it.
5. 05Animate with i2v. Feed the approved keyframe to an image-to-video model with a motion prompt that describes what moves and, just as importantly, what stays still. Keep clips in the 4–8 second range.
6. 06Grade the clips. Re-check identity and label fidelity across the clip’s full duration rather than the first frame alone, because drift accumulates over time. Weak clips get regenerated from the same approved keyframe.
7. 07Anchor the next shot. Start shot N+1 from a fresh keyframe generated against the same references, or from the last frame of clip N when you need direct visual continuity.

The gate is a checklist you apply to every still before it earns an i2v render. Ours is machine-graded, with a vision model scoring each candidate against the checklist and the references, and the checklist works manually too:

• Brand fidelity: is the label legible and correct? Are product proportions and colors right? Logos are where image models lie most confidently.
• Identity match: does the face actually match the creator reference, or just the general demographic? Compare side by side; squint tests fail here.
• Continuity: same outfit, same location, same lighting direction as the adjacent shots in the plan.
• Composition for purpose: subject placed mid-frame if the shot is identity-critical, headroom or negative space reserved if an overlay is planned.
• Artifacts: extra fingers, melted text, impossible reflections, or anything that reads as obviously synthetic at feed scroll speed.

One discipline matters most: keep the gate binary. A still that “mostly” passes does not get animated on the theory that motion will hide the flaw. Motion amplifies flaws, and a slightly-off label in a still becomes a visibly morphing label in a clip.

i2v models are conditioned on your keyframe at frame zero, but every subsequent frame is generated from model priors plus the frames before it. The further the clip runs from the anchor, the more the model’s own ideas leak in. Three failure modes account for most of our rejected clips:

Identity drift over clip duration

Faces, logos, and printed labels gradually wander from the reference as the clip plays. Frame one matches the keyframe; second six is a cousin of it. Mitigations: keep clips short (4–8 seconds), keep the identity-critical subject mid-frame where the model spends its capacity, and avoid fast camera moves on shots where the face or label must hold. If a shot needs a whip pan, make it a shot where identity doesn’t matter.

Motion overshoot

You ask for “she lifts the cup slightly” and get a toast, a head turn, and a camera orbit. i2v models maximize motion unless told otherwise. Fix it in the motion prompt: state what stays still (“camera locked, background static”), describe one motion per clip, and scale your adjectives down, because models read “slowly” as normal speed and “slightly” as a full gesture.

Props morphing

Interaction moments break props: hands passing in front of a product, a cup being set down, a bag being opened. That is where props change shape, labels rewrite themselves, and objects merge. Mitigate it by minimizing occlusion of the product in the keyframe composition, keeping hand-to-product contact brief, and generating extra candidates for any shot where interaction is essential. Some models hold props better than others, so we run several in production and route shots accordingly. Our comparison of AI video generators for ads covers which model wins which shot type.

A 30–40 second ad runs 6–12 shots. The naive approach of extending one generation, or feeding each clip’s output into the next, compounds drift: shot three anchors on shot two’s already-drifted final frame, and by shot six the creator is a stranger. Two anchoring strategies fix this:

• Fresh-keyframe anchoring (our default): every shot starts from a newly generated keyframe, built against the original product and creator references plus the shared look constants. Drift resets to zero at every cut. Cuts hide the seams; this is how most real ads are edited anyway.
• Last-frame anchoring (the exception): animate shot N+1 from the final frame of clip N. Use it only when two shots must connect continuously, as in a match cut or a continued gesture. You inherit whatever drift clip N accumulated, so grade that last frame as strictly as a fresh keyframe before animating from it.

In practice we mix them: fresh keyframes for nearly every cut, last-frame anchoring for the one or two transitions per ad that need continuous motion. Because every fresh keyframe generates against the same references and look constants, the shots still read as one continuous world. That consistency comes from the references rather than from chaining the video frames.

Model choice interacts with chaining too. Spend models with strong physics and native audio on hero shots, as we describe in our notes on Veo 3 for ad creative. Let faster, cheaper models handle high-volume keyframe iteration and the B-roll shots where you burn most of your 2–4 candidates.

Starting from zero? Generate stills rather than videos. Take your three best product photos and two clean images of your creator, spokesperson, or mascot, and spend a session on keyframes only: one location, one outfit, six compositions from a simple shot list. Grade them hard against the checklist above. Animate nothing until you have six stills you would approve as photographs, and when you do, use short clips with one motion each and the camera locked.

One discipline carries most of the value here: never animate an unapproved still. The rest is volume and routing, meaning more candidates per shot, the right model per shot type, and a QA pass on every output. That part stops scaling gracefully by hand, and our studio automates it end to end, from references to a beat-cut vertical ad. If you would rather skip building the pipeline and get the output, AI video ads at SHOT.IS run the keyframe-to-video workflow for you with the QA gates already in place.