wind-comic

💎 Sponsors · 赞助商

✨ Why Wind Comic?

Most "AI video" tools give you a 5-second clip from a one-line prompt. Wind Comic gives you a finished short-form drama — script, character bible, multi-shot storyboards, voice-acted lines, BGM, mouth-synced characters (indicative 2D lip bar out of the box; photorealistic face-level lip-sync via BYO wav2lip/SadTalker/MuseTalk or Kling), and a final mp4 — from the same single line.

It works because it doesn't try to be one giant model. It's an honest multi-agent pipeline where each role (Writer, Director, Producer, Character Designer, Storyboard Artist, Cameo Locker, Lipsync, Editor) is a specialist that hands off with strict consistency contracts. Plus a real-time multiplayer timeline to edit with your team like Figma for film.

   "A reborn CEO confronts his cheating ex-fiancée at her wedding."
                                       │
                                       ▼
   Writer ▶ Director ▶ Style Bible ▶ Char Designer ▶ Scene Designer ▶
   ▶ Storyboard (vision-audited) ▶ Video (multi-engine race) ▶
   ▶ TTS (per-character voice) ▶ Lipsync (Kling/Sync.so/Hailuo) ▶
   ▶ Editor (j-cut/l-cut + BGM per act + CJK subtitles) ▶ final.mp4

   + Real-time collab timeline (Yjs CRDT)
   + Bring-your-own LLM (3 env vars, 0 code change)
   + Plug-in image/video providers (12+ supported)
   + Lip-sync pipeline: viseme track → align score → drift auto-correct → engine render → back into timeline   (v10)
   + Template market: save a hit project → rate / favorite / one-click remix (with its voices)               (v10)
   + Per-project cost attribution + budget guard, four-dimension publish gate                                 (v10)

🏗 Architecture

Three views of the same engine. Open on GitHub to watch them animate — flowing dashes trace live data & control paths, traveling dots are data packets moving through the pipeline.

System architecture — five layers, top to bottom. The Director threads control across the seven pipeline agents (eight roles including the Director); the LLM gateway falls back DeepSeek → MiniMax with zero code change; 12+ media engines plug in behind one router; everything lands on a dual-driver (SQLite ⇄ PostgreSQL) platform.

Sequence — the lifecycle of one idea → film request, time flowing down. Two signature beats: the Vision-Audit retry loop (auto-regenerate any shot scoring < 70) and the multi-engine race (Seedance / Kling / Veo / Vidu — first good clip wins).

Data flow — the artifact refinery. One line of text is refined stage-by-stage (TEXT → JSON → PNG → IMG → MP4); every artifact is persisted to the dual-driver DB + asset store and is independently reusable, so any stage can be re-run in isolation.

🎞️ Diagrams are animated SVG, authored as code in assets/diagrams/ — crisp at any zoom, versioned with the source. (Animation renders on GitHub; the ModelScope mirror shows static PNG.)

🆕 New in v12.315 – v12.330 — direct the shot, don't re-roll the dice

Every tool can generate a clip. These three let you direct one — and they compose into a single loop: inspect → locate → retake only what's broken.

Director's console (v12.316–318) — place the actors and the camera on a top-down stage; the exact blocking becomes two things a model can actually use: a precise staging directive appended to the prompt ("Lin Wan at frame left in full shot; Lu Chen right of center in wide shot"), and a layout sketch fed through the existing [STORYBOARD LOCK] channel (layout only — style still comes from the prompt). Shot size and camera angle are derived from the geometry, not typed in by hand, so lens/framing and the written spec can't disagree. A deterministic composition audit reports who is out of frame, who is occluding whom, whether the camera clips an actor — before you spend a cent generating.

Segment retake (v12.315) — hate two seconds of an eight-second shot? Retake those two. The other six are byte-copied (-c copy), not re-encoded, so the part you liked doesn't lose a generation. Shot duration is unchanged by construction, which means the compressed timeline, voice-over delays, subtitle starts and EDL record-ins need no recomputation. Takes are versioned like voice retakes — adopt or roll back.

Frame-by-frame inspection (v12.328–330) — step through a finished shot frame by frame, box the broken stretch, and hand that exact range to segment retake. Frames are extracted with accurate seek (-ss after -i, not the fast keyframe-only seek), and the timestamp under each frame uses the same frame-snapping as the retake planner — so the frame you picked is the frame it cuts at. When the strip is thinned to stay responsive, it says so; frames that fail to decode are reported, not silently skipped.

Also in this range: fonts are self-hosted so builds no longer depend on a network fetch; the director paths finally receive the target language (non-Chinese projects used to get Chinese scripts and rely on a costly after-the-fact re-translation); the in-process rate limiter bounds and evicts its bucket table (the key contained an attacker-supplied email — an unbounded memory vector), and eviction never releases an active block; collaborative comments arriving over Yjs are validated and field-whitelisted, so a peer can no longer overwrite another author's name or text.

🆕 New in v12 — the quality loop era

Sketch-Lock storyboarding — every shot first renders a B/W composition sketch, then the final frame is generated locked to that composition (toggle at creation time, or per-shot in the Shot Workshop). Camera language finally survives the diffusion lottery.

Emotion-driven camera — shots missing camera movement get one derived from story beats (hook→push-in, chase→handheld, reveal→zoom-in, farewell→pull-out, emotion temperature → push/orbit/crane). Even the Ken Burns degradation follows the intended move.

Engine matrix, honestly — Veo · MiniMax (Hailuo) · Kling (official Beijing API) · HappyHorse 1.1 (Alibaba, v12.272 — joint video+audio in one pass) with a one-line env priority (VIDEO_ENGINE_ORDER=kling,minimax,veo,happyhorse), base64 first-frame channel for local assets, and an honest fallback chain: a failed shot becomes a labeled animatic, never a still image masquerading as video.

The quality loop — ffprobe-powered film health report (aspect/duration/fps/bitrate/audio/degraded shots) per project and per series; batch re-render of degraded shots (2-way concurrent); a season-export health gate so no broken episode sneaks into the compilation; an engine weather bar so you know before you hit generate.

Round-trip storyboards — export the pull sheet as CSV / Markdown / print-ready PDF (with character sheet + health appendix), edit in Excel, import it back — changed visual fields offer one-click re-render of exactly the affected shots.

Writer resilience — truncated or quote-mangled LLM scripts are salvaged (bracket-stack completion + content-quote escaping) instead of being silently replaced by a template. The real 23KB incident dump lives in the test fixtures.

🆕 Earlier: v6 → v10 — from demo to production platform