Skip to content

/story-to-video-workflow

Orchestrates story, script, screenplay, concept, product promo, and multi-shot idea work into finished video. Use first when the user asks to make a video from a story or script; asks what next in a story video project; or needs a decision spanning script splitting, image refs,

From plugin
pai-code
3526 skills

Claude Code

$ npx -y skills add utopai-research/pai-code --skill story-to-video-workflow --agent claude-code

SKILL.md

story-to-video-workflow.SKILL.md
name: story-to-video-workflow
description: >-
  Orchestrates story, script, screenplay, concept, product promo, and
  multi-shot idea work into finished video. Use first when the user asks to
  make a video from a story or script; asks what next in a story video project;
  or needs a decision spanning script splitting, image refs, voices or VO,
  video clips, render strategy, Timeline ordering, or final Timeline handoff.
  Routes execution to script-compose, image-compose, voice-compose, and
  video-compose before those skills' CLIs are used.

Story-to-video workflow

Contract

  • This skill wakes first for story/script/promo-to-video work.
  • Own sequencing only. Before execution, load the matching capability skill; do not call `generate_*` here.
  • Recommendations are not consent. Stop before paid generation or pipeline changes unless the user explicitly approved an autonomous workflow.

Default arc

Use this ladder unless the user skips, reorders, supplies refs, or asks for a rough direct render:

1. Clarify only blockers. 2. Raw idea/story -> `script-compose` production script; existing screenplay -> capture/adapt. 3. `script-compose` splits <=15s dialogue-aware shots and extracts characters, material variants, detailed locations/location variants, and speaker/VO needs. 4. `image-compose` creates useful visual anchors: base/variant character sheets and detailed location/detail anchors. 5. `voice-compose` creates reusable anchors for every speaker and VO/narrator. 6. Confirm shot count, durations, continuity needs, and first blocker. 7. Default render path: straight-to-video from refs. Storyboard only if requested, hard to control, or needed for diagnosis. 8. Default dispatch: hybrid. Chain continuous dependent shots; render independent scenes/shots in parallel. 9. Render clips, assign Timeline `shot_id` when sequence order is unambiguous, then hand off to Timeline.

Plan ahead internally, but only ask the next meaningful user-facing choice; the Consent and gates ladder fixes when render path and dispatch become askable.

Skill routing

| Need | Load next | |---|---| | Script capture, rewrite, split, or analysis | `script-compose` | | Character, location, storyboard, starting frame, or visual anchor | `image-compose` | | Narration, dialogue read, character voice, or audio node | `voice-compose` | | Clip render, continuation, audio refs, storyboard animation, or video prompt | `video-compose` | | Scene/ref grouping or canvas layout frames | `groups-compose` |

Capability skills own CLI flags, node grammar, refs, and recovery hints. `PROJECT_AGENT.md` owns shared failure handling.

Consent and gates

  • Draft-only, failed, and cancelled generations do not advance the pipeline.
  • One-off generation outside the story pipeline routes directly to the capability skill.
  • Honor explicit rough-direct/skip choices.
  • Gate ladder: script -> shot notes -> anchors/user refs/rough-direct -> real clip plan -> render path -> dispatch. Ask each rung only after the prior one is real; stop after render-path unless the user already names dispatch too.

VO and dialogue invariants

  • Script/shot notes carry dialogue/VO until final audio exists.
  • `audio_result.data.text` is source of truth only for approved final narration/line reads.
  • `video-compose` includes spoken text verbatim and treats voice samples as timbre anchors.

Recommendation shape

Follow the project `PROJECT_AGENT.md` § "Recommendation and choice shape". Recommend one concrete next step. Add a second option only when there is a real tradeoff.

Planning checkpoint

Before recommending refs/video, inspect `workflow.json` when needed and summarize only:

  • Target duration from user duration, timestamps, or a rough estimate.
  • Planned <=15s shot count.
  • Characters, material variants, detailed locations/location variants, close/detail needs, speakers/VO.
  • First missing anchor blocking the next clip.

If the story implies more than roughly 3 minutes, recommend narrowing scope before clip planning.

After shot notes, missing video-bound character/location/voice anchors are the default next step; include a rough-direct skip when speed matters. Once anchors/user refs/rough-direct are settled, offer only a short ref review or clip-plan confirmation if ambiguity remains.

Render path

Ask only after the script/shot plan is settled and anchors, usable refs, rough-direct, or a simple single-clip case make rendering real. If anchors are still missing, return to Planning checkpoint.

Use project choice shape:

  • header: `Render`
  • question: `Choose render path.`
  • options:
  • label: `Straight to video (Recommended)`

description: `Fastest path to motion.`

  • label: `Storyboard first`

description: `Generate storyboard images first for composition control.`

For storyboard-first, load `image-compose` Pattern 6: one composite mosaic per clip/<=15s shot note, subtype `storyboard`.

Dispatch for multiple clips

Ask only after render path is picked and a multi-clip plan exists. Skip for one clip. Use project choice shape:

  • header: `Dispatch`
  • question: `Choose clip dispatch.`
  • options: order these by the observable story signals below; suffix the first label with `(Recommended)`.
  • label: `Hybrid`

description: `Chain within continuous scenes; render separate scenes independently.`

  • label: `Parallel`

description: `Render all clips independently.`

  • label: `Sequential`

description: `Each clip continues from the previous one; boundaries default to a hard cut to a new angle (avoids the same-shot seam) — keep a boundary same-shot only for an unbroken oner.`

Signals: continuous scene/state -> sequential (hard-cut handoffs between clips); a single unbroken action the viewer must read as ONE motion -> one ≤15s clip, else sequential with a same-shot handoff; separate scenes/time jumps/wardrobe changes/montage -> parallel; continuous clusters separated by hard cuts -> hybrid. Do not chain video refs acr

Read more
@utopai-research
Ships withpai-code

The local AI filmmaking studio, driven from your coding agent. [![Codex supported](

Stars on GitHub

Momentum

stars in total
352
Star history of Utopai-Research/pai-pro on GitHub, a chart by star-history.com

Other skills on pai-code.

groups-compose
Auto-invoked

groups-compose

Designs and maintains semantic groupings and readable layouts on the filmmaking canvas — scenes, character-reference sets, act…

image-compose
Auto-invoked

image-compose

Generates/edits filmmaking canvas images via generate_image.js and generate_image_pro.js. Use before image CLIs for…

script-compose
Auto-invoked

script-compose

Handles explicit screenplay/story work on the filmmaking canvas. Triages screenplay (use verbatim), story/concept (iterate then…

video-compose
Auto-invoked

video-compose

Generates and prompts video clips on the filmmaking canvas. Use when the user asks to generate, render, animate, continue,…

voice-compose
Auto-invoked

voice-compose

Designs and attaches voice samples or final narration/line audio on the filmmaking canvas via the local generate_voice.js CLI.…

More skills from other plugins.

prompt-lookup

prompt-lookup

Activates when the user asks about AI prompts, needs prompt templates, wants to search for prompts, or mentions prompts.chat. Use…

@gh-f@gh-fInstall Skill
ppt-master

ppt-master

AI-driven presentation workflow for generating editable PPTX decks and slides, reconstructing page visuals, creating reusable…

@hugohe3@hugohe3Install Skill
morph-ppt

morph-ppt

Use this skill when the user wants a .pptx with smooth cross-slide animation — PowerPoint Morph transitions, Keynote-style…

@iofficeai@iofficeaiInstall Skill

Questions about story-to-video-workflow.

Which coding agents can use story-to-video-workflow?
story-to-video-workflow installs in Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode and Windsurf with the skills CLI, using each agent's flag shown on this page. Flowy's auto-invocation, which fires a skill when your prompt matches, runs in Claude Code only.