wind-comic

One sentence in. A finished short-form drama out — script, cast, storyboards, voiceover, timeline, mp4. Multi-agent AI studio · reusable characters · novel→season splitting · director's control room · real-time collab · bring-your-own LLM.

一句话进,整片短剧出 —— 剧本 · 角色 · 分镜 · 配音 · 时间线 · mp4 一条龙。 多 Agent AI 创作工作室 · 可复用角色 · 长篇小说→自动分集 · 导演级控片台 · 实时协作 · 自带 LLM。

English · 简体中文 · 🔥 Pitch · 🔌 BYO LLM

Mirror for mainland China · 国内 AtomGit 托管(自动同步自 GitHub):atomgit.com/ChrisChen667788/wind-comic

▶ Watch the full 39-second promo — with voiceover & sound Real cinematic footage woven with motion-graphics · 8 distinct art styles · English narration · scored by the platform's own MiniMax music engine.

✨ Why Wind Comic?

Most "AI video" tools give you a 5-second clip from a one-line prompt. Wind Comic gives you a finished short-form drama — script, character bible, multi-shot storyboards, voice-acted lines, BGM, mouth-synced characters (indicative 2D lip bar out of the box; photorealistic face-level lip-sync via BYO wav2lip/SadTalker/MuseTalk or Kling), and a final mp4 — from the same single line.

It works because it doesn't try to be one giant model. It's an honest multi-agent pipeline where each role (Writer, Director, Producer, Character Designer, Storyboard Artist, Cameo Locker, Lipsync, Editor) is a specialist that hands off with strict consistency contracts. Plus a real-time multiplayer timeline to edit with your team like Figma for film.

   "A reborn CEO confronts his cheating ex-fiancée at her wedding."
                                       │
                                       ▼
   Writer ▶ Director ▶ Style Bible ▶ Char Designer ▶ Scene Designer ▶
   ▶ Storyboard (vision-audited) ▶ Video (multi-engine race) ▶
   ▶ TTS (per-character voice) ▶ Lipsync (Kling/Sync.so/Hailuo) ▶
   ▶ Editor (j-cut/l-cut + BGM per act + CJK subtitles) ▶ final.mp4

   + Real-time collab timeline (Yjs CRDT)
   + Bring-your-own LLM (3 env vars, 0 code change)
   + Plug-in image/video providers (12+ supported)
   + Lip-sync pipeline: viseme track → align score → drift auto-correct → engine render → back into timeline   (v10)
   + Template market: save a hit project → rate / favorite / one-click remix (with its voices)               (v10)
   + Per-project cost attribution + budget guard, four-dimension publish gate                                 (v10)

🏗 Architecture

Three views of the same engine. Open on GitHub to watch them animate — flowing dashes trace live data & control paths, traveling dots are data packets moving through the pipeline.

System architecture — five layers, top to bottom. The Director threads control across the seven pipeline agents (eight roles including the Director); the LLM gateway falls back DeepSeek → MiniMax with zero code change; 12+ media engines plug in behind one router; everything lands on a dual-driver (SQLite ⇄ PostgreSQL) platform.

Sequence — the lifecycle of one idea → film request, time flowing down. Two signature beats: the Vision-Audit retry loop (auto-regenerate any shot scoring < 70) and the multi-engine race (Seedance / Kling / Veo / Vidu — first good clip wins).

Data flow — the artifact refinery. One line of text is refined stage-by-stage (TEXT → JSON → PNG → IMG → MP4); every artifact is persisted to the dual-driver DB + asset store and is independently reusable, so any stage can be re-run in isolation.

🎞️ Diagrams are animated SVG, authored as code in assets/diagrams/ — crisp at any zoom, versioned with the source. (Animation renders on GitHub; the ModelScope mirror shows static PNG.)

🆕 New in v13.0 — the frame you set is the frame you get

v13.0 consolidates v12.461 – v12.473 (13 releases, 2026-09-30 → 10-09). One pattern ran through most of them: settings that looked like they worked but had no code reading them, and engine requests that looked like they succeeded but sent the wrong thing.

Aspect ratio, end to end (v12.464, 467, 468, 470 – 473) — until v12.467 only full-film generation read the project's aspect ratio. Regenerating a single shot, self-healing retakes, segment retake, 4K re-render, recomposing after a chat edit, scene-image regeneration and the ad workshop each fell back to their own 16:9 or 9:16, so a 9:16 project could get a landscape shot back. They now all read projects.aspect through one shared parser. Prompt templates no longer hard-code --ar 16:9 (a vertical project used to send Midjourney both --ar 16:9 and --ar 9:16); Midjourney parameters are moved to the end and appear once, and non-Midjourney image engines and the video engines receive plain text. The create page no longer offers 2.35:1, which no video engine we ship can output; the ad workshop's aspect is now selectable and defaults to the project's.

Settings that finally have a reader (v12.464, 466, 469, 473) — the format bar's color space now goes into storyboard prompts, its safe-area toggle drives the 9:16 overlay, and its aspect is a read-only display of the project's real aspect instead of a second, dead copy. The short-video planner dropped the resolution / frame-rate / upscaling / interpolation / motion-strength controls that nothing read (the defaults claimed 8K, 4× upscale and interpolation), and its aspect choice now carries over to the create page.

Director's console, finished (v12.462, 463, 465) — add, remove and rename actors; the camera can tilt, and "aim at subjects" points a raised camera at the actors; the layout sketch re-renders when the blocking changes, and shots generated from the old blocking are marked stale. The sketch goes only to engines that compose from it (fal Kontext, Seedream; Midjourney as an opt-in) — never to MiniMax, whose reference input is portrait-only. The full walkthrough — real WebGL (software-rendered in CI) and real MediaPipe pose inference — now runs in CI.

Engine requests that were silently wrong (v12.461, 465, 471, 472) — MiniMax's subject_reference[].image_file had been sent as an array since v2.20 while the official schema is a string, so every MiniMax generation with reference images was rejected (2013) and quietly fell back to another engine; a live call found it. The Vidu host default existed twice, one copy wrong; Midjourney prompts carried duplicated and mid-prompt parameters; video engines were handed Midjourney syntax as prompt text.

Not verified yet: sketch delivery to Seedream / kontext / Midjourney follows their documented request formats but could not be confirmed with a live generation (gateway quota exhausted / no Midjourney channel / upstream saturated on 10-01, 10-06 and 10-08); npx tsx scripts/probe-sketch-engines.ts --yes <engine> re-runs the check, one paid image per engine. fal is unverified (no key configured).

🆕 New in v12.315 – v12.330 — direct the shot, don't re-roll the dice

Every tool can generate a clip. These three let you direct one — and they compose into a single loop: inspect → locate → retake only what's broken.

Director's console (v12.316–318) — place the actors and the camera on a top-down stage; the exact blocking becomes two things a model can actually use: a precise staging directive appended to the prompt ("Lin Wan at frame left in full shot; Lu Chen right of center in wide shot"), and a layout sketch fed through the existing [STORYBOARD LOCK] channel (layout only — style still comes from the prompt; the sketch goes only to engines that actually compose from it — fal Kontext and Seedream, with Midjourney image prompts as an opt-in; MiniMax's reference input is portrait-only, so it never gets the sketch. When no such engine is available the lock is skipped, and if generation falls back to an engine that didn't receive the sketch the lock line is stripped — never claimed). Shot size and camera angle are derived from the geometry, not typed in by hand, so lens/framing and the written spec can't disagree; the camera can tilt up and down (v12.465), and "aim at subjects" points a raised camera at the actors in one click — the prompt, the 3D preview and the layout sketch all describe the same camera. A deterministic composition audit reports who is out of frame, who is occluding whom, whether the camera clips an actor — before you spend a cent generating.