One sentence in. A finished short-form drama out โ script, cast, storyboards, voiceover, timeline, mp4.
Multi-agent AI studio ยท reusable characters ยท novelโseason splitting ยท director's control room ยท real-time collab ยท bring-your-own LLM.
ไธๅฅ่ฏ่ฟ,ๆด็็ญๅงๅบ โโ ๅงๆฌ ยท ่ง่ฒ ยท ๅ้ ยท ้
้ณ ยท ๆถ้ด็บฟ ยท mp4 ไธๆก้พใ
ๅค Agent AI ๅไฝๅทฅไฝๅฎค ยท ๅฏๅค็จ่ง่ฒ ยท ้ฟ็ฏๅฐ่ฏดโ่ชๅจๅ้ ยท ๅฏผๆผ็บงๆง็ๅฐ ยท ๅฎๆถๅไฝ ยท ่ชๅธฆ LLMใ
English ยท ็ฎไฝไธญๆ ยท ๐ฅ Pitch ยท ๐ BYO LLM
Most "AI video" tools give you a 5-second clip from a one-line prompt. Wind Comic gives you a finished short-form drama โ script, character bible, multi-shot storyboards, voice-acted lines, BGM, lip-synced talking heads, and a final mp4 โ from the same single line.
It works because it doesn't try to be one giant model. It's an honest multi-agent pipeline where each role (Writer, Director, Producer, Character Designer, Storyboard Artist, Cameo Locker, Lipsync, Editor) is a specialist that hands off with strict consistency contracts. Plus a real-time multiplayer timeline to edit with your team like Figma for film.
"A reborn CEO confronts his cheating ex-fiancรฉe at her wedding."
โ
โผ
Writer โถ Director โถ Style Bible โถ Char Designer โถ Scene Designer โถ
โถ Storyboard (vision-audited) โถ Video (multi-engine race) โถ
โถ TTS (per-character voice) โถ Lipsync (Kling/Sync.so/Hailuo) โถ
โถ Editor (j-cut/l-cut + BGM per act + CJK subtitles) โถ final.mp4
+ Real-time collab timeline (Yjs CRDT)
+ Bring-your-own LLM (3 env vars, 0 code change)
+ Plug-in image/video providers (12+ supported)
v3 shipped the pipeline. v6 turned it into a production studio; v7โv9 hardened it into a platform. Reusable characters, a prompt IDE, novelโseason auto-splitting with real voiceover, a 60-style gallery, a director's control room, team credit budgets, an industry-grade script audit (Polish Pro, v7.1), a premium design pass (v8.3), a fully-migrated Postgres backend (v9), and a live API health board โ every screen below is a real capture of the running app.
Plus Jakarta Sans + Phosphor icons, gold-tinted machined-bezel cards, spring motion, an asymmetric bento dashboard, a 60-thumbnail style gallery, and AI-generated gold-neon genre icons replacing every default emoji.
![]() Asymmetric bento dashboard โ tall create-hero + machined-bezel cards |
![]() 60-style gallery, every thumbnail AI-rendered (same subject ร each look) |
![]()
Story-template gallery โ 18 cohesive AI gold-neon genre emblems (no more default emoji)
| Version | What landed |
|---|---|
| v6.0 ยท Character Studio | Reusable cast assets โ multi-view turnaround sheets (front / ยพ / profile / back) with an 8-field DNA identity lock, auto-bound voice timbre, deterministic bio. Reuse any character across projects via the Cameo IP economy. |
| v6.1 ยท Prompt Workbench | @-mention any asset right in your prompt, live autocomplete, a compile-preview that expands every reference, and a pre-generation readiness score. |
| v6.2 ยท Long-form Intake | Paste a whole novel โ auto-split into episodes (chapter-aware) โ choose a narration mode (dialogue / first-person / narrator). v6.2.3 renders narration to real TTS with N-episode parallel orchestration; v6.2.4 persists the audio + burns SRT subtitles into the timeline. |
| v6.3 ยท Style Gallery | 60 cinematic presets across 5 categories, instant search, one-click apply-to-workshop. |
| v6.4 ยท Director Console | The whole pipeline as 4 stages (script โ assets โ storyboard โ final) with ready / stale detection, one-click single-stage rerun, and downstream-impact analysis. |
| v6.5 ยท Team Workspace | Owner-managed credit pool, per-member allocations + RBAC, real multi-user invites (token links), per-member consumption metering. |
| v6.6 ยท Postgres-ready | Full SQLiteโPostgres cutover path, verified end-to-end on a local Postgres (schema bootstrap + async-repo round-trip, idempotent migrate). |
| v6.7 ยท API Health Board | One screen to see which gateway is healthy / out-of-credits / misconfigured โ with live balance read-out, so you never hit a dead generation mid-flow again. |
| v6.8 ยท Strongest models | Primary LLM/video/image repointed to top-tier models (veo3.1-pro, etc.) and fixed a video-stage 429 upstream-saturated error by rerouting the gateway. |
| v6.9 ยท Gateway gap-fill | A supplement gateway backfills TTS / Midjourney / Kling; real voiceover via gpt-4o-mini-tts; per-gateway usage + balance on the health board. |
| v7.0 ยท DeepSeek + universal fallback | Writer/Director run on DeepSeek's strongest deepseek-v4-pro; every LLM call auto-falls back to MiniMax on any error / out-of-credits / timeout. 3-tier LLM health on the board. |
| v7.1 ยท Polish Studio Pro | Paste a draft, hit Pro: deepseek-v4-pro returns a polished script plus a full industry audit โ AIGC-readiness score, Save-the-Cat 3-act beat-gap detection, on-the-nose dialogue flags, per-character Cameo/Seedance identity anchors. Tiered models (flash for speed, pro for depth) fixed the reasoning-token instability. |
| v7.2โv8.0 ยท AI director console (้ถๆฎตไน) | Per-shot cinematography console (ๆฏๅซ/ๆบไฝ/้ๅคด/่ฟ้/็ฆ็น), continuity + seed lock, project-format bar, emotion/rhythm curves, JSONโvisual parameter linkage โ all converging into one 11-tab director station per project. |
| v8.1โv8.3 ยท Premium design pass (Taste Skill) | Plus Jakarta Sans + Phosphor icons, gold machined-bezel cards, spring motion, an asymmetric bento dashboard, 60 AI-rendered style thumbnails, and AI gold-neon genre icons replacing every default emoji (18 templates + 5 modes + 8 looks). |
| v9.0โv9.0.2b ยท Postgres full cutover | SQLiteโPostgres dual-driver; every write path migrated to async repos โ project_assets ยท projects ยท users ยท notifications ยท comments all cleared โ verified end-to-end on a local Postgres with transaction commit + rollback atomicity. Default stays SQLite (same file, zero split-brain); DB_DRIVER=pg is opt-in. 1857 tests green on both drivers. |
Every stage at a glance โ what's ready, what's gone stale because you changed something upstream, and a one-click rerun that knows exactly which downstream stages it invalidates.
Paste a full novel; Wind Comic splits it into episodes by chapter markers (or by target length), picks a narration mode, and can render a real narration track + burnable subtitles for the whole season in parallel.
Lock a consistent visual identity before you generate. Search, filter by category, and apply any preset straight into the creation workshop.
Live status for every model and gateway: ๆญฃๅธธ / ้ขๅบฆ็จๅฐฝ / ้ ็ฝฎ็ผบๅคฑ / ไธๅฏ่พพ, with real balance read-out and a "ๅปๅ ๅผ / ่กฅ้ ็ฝฎ" hint. Keys are never stored or returned.
Paste a draft, hit Pro: deepseek-v4-pro returns a polished script plus a full industry diagnostic โ AIGC-pipeline readiness score (e.g. 85/100), style profile, first-3-second hook strength, Save-the-Cat 3-act breakdown with missing beats called out, on-the-nose dialogue lines flagged, and per-character Cameo/Seedance identity anchors so every shot stays on-model.
Every character gets a real 3-view turnaround sheet (front / three-quarter / back) with a locked structured "DNA prompt" โ face geometry, skin tone, signature props, color palette, silhouette identity, full body pose โ so the same actor reads identically across all 6 shots. The Cameo IP economy lets the same character travel between projects.
One project, eleven tabs of cockpit-grade control: ๅฏผๆผๅฐ ยท ๅงๆฌ ยท ่ง่ฒ ยท ๅบๆฏ ยท ๅ้ ยท ่ฟ่ดฏๆง ยท ่ง้ข ยท ้ๅคดๅทฅๅ ยท Cinema ๆถ้ด็บฟ ยท ่ๅฅๅๆ ยท ๆ็่ดจๆฃ ยท ๆๆฏ็็ ยท ๅๆฐ่ๅจ ยท ่ฏ่ฎบๅไฝ ยท ๅฎๆดๆญๆพ. The finished film plays right in the workspace with a 90/100 audit badge and one-click mp4 / platform export.
![]() Credit pool + per-member allocations, RBAC, real invite links. |
![]() Multi-track timeline; narration audio + subtitles burned in. |
| You are... | What Wind Comic gives you |
|---|---|
| Vertical short-drama creator (้ธๆป / ้็ / ๆ็ฅ / ๅค่ฃ ) | Trope-aware Writer, hook-first shot 1, reversal density audit, cliffhanger detection, 9:16 default |
| Content marketing team | 1 idea โ 30-second polished ad with consistent characters across cuts, real Chinese subtitles burnt in, brand-safe negative prompts |
| Indie filmmaker / video artist | Style Bible locks the visual identity across all shots, McKee-structured story beats, Logic-Pro-style multi-track timeline, real BGM waveform editor |
| Comic / manhua adaptation studio | Script โ storyboards in your chosen art style, character consistency via cref+sref+DNA, drag-rearrange shots, regenerate single shots |
| Educator / explainer | Pacing audit warns when content is too flat, conflict-score per shot, suggestions for hooks |
| Open-source builder | Swap any LLM with 3 env vars (OpenAI / Anthropic / DeepSeek / Qwen / Kimi / OpenRouter / Ollama local โ all work) |
Director plans the story โ Writer drafts dialogue under McKee structure โ Style Bible Frame locks the look โ Character Designer extracts an 8-dimension DNA signature of each character โ Storyboard renders with Vision Audit (auto-regen on <70 score) โ Video producer races multiple engines (Minimax / Veo / Kling) โ Editor cuts j/l-cut on emotional beats and burns CJK subtitles.
We render one canonical "key art" frame from the Director's plan, then pass it as the first --sref of every subsequent storyboard render. Net effect: all 6 shots feel like they came from the same show, not 6 random Midjourney runs. (Most competitors only carry a 2-frame rolling chain โ shot 6 doesn't know what shot 1 looked like.)
Writer prompt detects ็ญๅง/ๆผซๅง genres and switches to vertical canvas + injects proven hook patterns (้็ๅๅฐ N ๅนดๅ ยท ๅฝ่กๆๆด + ็งๅฏ่บซไปฝ ยท ็ณป็ปๆ็คบ้ณ็ชๅ ยท etc). McKee 3-act still backs it; tropes are the surface.
The garbled-Chinese-text-in-AI-video problem solved properly: we strip dialogue text from the video prompt (so the model doesn't try to draw garbled glyphs) + add aggressive negatives (--no text --no chinese --no captions) + post-bake real subtitles with ffmpeg subtitles filter using a system CJK font (PingFang / Noto Sans CJK).
Beyond reference image hacks, we run each character's turnaround sheet through Vision LLM to extract structured features (eye shape / jaw angle / hair style / signature outfit etc.), then inject as natural-language anchor into every shot prompt. Combined with cameo-vision-retry: if a shot's character match scores <75, we auto-regen with boosted cw.
- 3 tracks: shots / BGM / subtitle
- Real BGM waveform decoded via Web Audio API (not procedural)
- Drag-to-retime + edge handles to resize duration
- Auto-snap to neighbors within 0.4s threshold + hard-clamp on overlap
- Real-time multiplayer: Yjs awareness paints other users' cursors live, presence avatars show which tab each collaborator is in, Y.Map locks prevent two people editing the same segment
- Project invites with viewer/commenter/editor role gating
Kling lip-sync API for talking heads, with Sync.so and Hailuo as auto-fallback. The pipeline strips dialogue from the prompt so the model only generates lip motion; we then sync the lips to the TTS audio in post.
After Writer finishes, we score each shot 0-10 on a Chinese-conflict-word dictionary + detect emotional polarity reversals + cliffhanger keywords. If a vertical drama has <2 reversals or shot-1 conflict <5, you see a warning in the dedicated Pacing tab with actionable suggestions.
Every text-LLM call (Director / Writer / Vision / Audit) goes through one OpenAI-compatible chat/completions endpoint. Want to swap to DeepSeek-r1 / GPT-4o / Claude (via OpenRouter) / Qwen-Max / local Ollama? Edit 3 lines in .env. Zero code change. See docs/llm-providers.md for the full matrix.
Every feature listed above is in main, type-checked, unit-tested, and visible at /projects/[id] if you npm install && npm run dev right now.
| Capability | Sora 2 | Kling 2.0 | Vidu Q3 | Runway Gen-4 | Higgsfield | Wind Comic |
|---|---|---|---|---|---|---|
| Multi-shot story from one prompt | โ | โ | โ multi-agent | |||
| Character consistency across shots | โ | cref/sref hack | subject-ref | scene memory | โ | โ cref + sref + 8-dim DNA + vision retry |
| Style coherence locked | โ | โ | โ | โ Style Bible Frame | ||
| Real CJK subtitles | โ | โ | โ | โ libass + PingFang burn | ||
| Vertical drama tropes | โ | โ | โ | โ | โ | โ 12 templates + 9:16 default |
| Real-time multiplayer timeline | โ | โ | โ | โ | โ Yjs CRDT + Y.Map locks + cursors | |
| Self-hostable | โ | โ | โ | โ | โ | โ Next.js + SQLite + Web Audio |
| BYO LLM (OpenAI / Claude / DeepSeek / local) | โ | โ | โ | โ | โ | โ 12+ providers via .env |
| Open source | โ | โ | โ | โ | โ | โ MIT |
| Per-shot regenerate with custom prompt | โ | โ | โ + reference image upload | |||
| Pacing / conflict audit | โ | โ | โ | โ | โ | โ shot-level score + reversal detection |
Cells marked
โ ๏ธ = the feature exists but in a limited / locked-down form (e.g. "you can only do this on a paid Pro tier through a UI panel").
Below is the foundational v3 pipeline (the v6 studio screens are in the New in v6 section above). Every panel is a real puppeteer capture of the running app (run node scripts/capture-screenshots.mjs / node scripts/capture-v6.mjs to refresh).
The ๅไฝๆป่ง dashboard: 99 projects + 4 case studies + recent activity feed + system status (engines in use, model versions).
Cross-project reusable: ่ง่ฒ / ๅบๆฏ / ่ง้ข / ้ณไน / ๅญๅน / ๆจกๆฟ โ 1467 assets in this demo project.
Every short film with auto-generated cinematic covers + status badges + quality donut.
The whole pipeline as a live agent flow: Writer / Character Designer / Scene Designer / Storyboard Artist / Video Producer / Editor nodes wired together with progress streaming per node, plus a chat side-rail showing every agent message in real time.
The ๅงๆฌ tab: every shot with duration, emotion tag (่ญฆ่ง / ๅ้ / ๆๆ / ๆด้ฃ็ๆฒ็ / ้ๅฎ็ไธๆณจโฆ) and a one-line beat note (ไป่กจ้ขๅฐๆทฑๅฑ่ญฆ่ง / ไปๆ ็ฅๅฐๆ็ฅๅจ่ / ไป่ญฆๆๅฐ้ญๅ่ขญๅป โฆ) so the rhythm of the cut is legible at a glance.
3-track layout (SHOTS / BGM / SUBTITLE), drag-to-retime, double-click subtitles to rewrite, drag edges to resize, real BGM waveform (Web Audio decode), live other-user cursors with name labels, segment lock indicators.
KPI: ๅนณๅๅฒ็ชๅ / ๅ่ฝฌๆฐ / ้่ฟ็ถๆ. Per-shot conflict-score bar chart with reversal arrows + emotional polarity icons. Color-coded green (โฅ7) / amber (4-6) / red (<4). Below: actionable warnings + suggestions.
Project-level + per-shot threaded comments with @-autocomplete and notification bell. Each shot collapses for context.
Per-shot "ๆน prompt ้็" (regenerate image with custom prompt + reference image upload) and "4K ้ๆธฒ" (Kling Master 4K re-render, plan-gated).
| What it does | Where it lives | |
|---|---|---|
| Multi-agent pipeline | Director / Writer / Char Designer / Storyboard / Editor โ 8 agents | services/hybrid-orchestrator.ts |
| Style Bible Frame | One canonical key-art frame locks visual identity across all shots | lib/style-bible.ts |
| Character DNA | 8-dim vision-extracted character signature + per-shot prompt injection | lib/character-dna.ts |
| Style Vision Audit | Auto-regen any shot scoring <70 on palette/lighting/colorTemp/texture | lib/style-audit.ts |
| Cameo Vision Retry | Auto-regen any shot scoring <75 on character resemblance | services/cameo-retry.ts |
| Pacing Audit | Conflict-score / reversal-detect / cliffhanger per Chinese drama tropes | lib/pacing-audit.ts |
| Drama Tropes | 12 vertical-drama hook templates + 9:16 default + reversal density rules | lib/drama-tropes.ts |
| CJK Subtitle Burner | ffmpeg libass with system CJK font discovery | lib/text-control.ts + services/video-composer.ts |
| Multi-track Timeline | 3 tracks, drag/resize/snap/auto-collide, BGM waveform | components/project/cinema-timeline.tsx + lib/timeline-tracks.ts |
| Real-time collab | Yjs CRDT + WS server + presence + cursors + segment locks | scripts/ws-server.mjs + hooks/use-yjs.ts + hooks/use-segment-locks.ts |
| Project invites | viewer/commenter/editor role + token expiry + revoke | lib/project-share.ts |
| Comments + @mentions | Threaded comments, @-autocomplete, mention notifications | lib/comments.ts + lib/notifications.ts |
| Lipsync | Kling / Sync.so / Hailuo auto-select, fail-safe fallback | services/lipsync.service.ts |
| Plan-gate billing | Per-engine plan checks (Vidu Q3 = enterprise, etc.) | lib/plan-gate.ts |
| API quota tracker | Per-provider failure tracking + dashboard banner | lib/api-usage-tracker.ts |
| 18 project templates | ้ธๆป/้็/็ฉฟ่ถ/ๅค่ฃ /็งๅนป/ๅฟ็ซฅ/็บชๅฎ/ๆๆ/ๅๅง etc. | lib/story-templates.ts |
| BYO LLM docs | 12-provider config matrix, 0-code swap | docs/llm-providers.md |
| ๐ Character Studio | Multi-view turnaround + DNA lock + auto-bound voice + bio | lib/character-studio.ts |
| ๐ Prompt Workbench | @-mention assets, autocomplete, compile-preview, readiness score |
lib/prompt-ide.ts + components/prompt-editor.tsx |
| ๐ Long-form Intake | Novelโepisodes + narration modes + real TTS + season parallel | lib/story-intake.ts + lib/narration-synth.ts + lib/season-orchestrator.ts |
| ๐ Style Gallery | 60 presets, 5 categories, one-click apply | lib/style-presets.ts + app/dashboard/styles |
| ๐ Director Console | 4-stage pipeline model + stale detection + single-stage rerun | lib/pipeline-stages.ts + components/director-console.tsx |
| ๐ Team Workspace | Credit pool + per-member allocations + RBAC + real invites | lib/team-credits.ts + lib/team-invite.ts |
| ๐ Postgres cutover (v9) | SQLiteโPG dual-driver; all write paths on async repos (project_assets/projects/users/notifications/comments cleared), tx commit+rollback verified, DB_DRIVER=pg opt-in |
lib/db-driver.ts + lib/repos/* + scripts/pg-migrate.ts |
| ๐ API Health Board | Live model/gateway status + balance + out-of-credits detection | lib/provider-health.ts + app/dashboard/health |
Every model call is provider-pluggable (priority chain + automatic fallback). The current default routing splits a primary gateway from a supplement gateway, with MiniMax always last as the safety net:
| Capability | Primary (strongest) | Supplement | Fallback (unchanged) |
|---|---|---|---|
| LLM (writer / director / vision-audit) | claude-opus-4-7 ยท claude-sonnet-4-6 |
โ | MiniMax / XVERSE |
| Video | veo3.1-pro (Veo 3.1 Pro) |
Kling | MiniMax Hailuo |
| Image | flux-2-pro (IMAGE_MODEL) |
Midjourney (mj_imagine) |
MiniMax image-01 |
| TTS / voiceover | gpt-4o-mini-tts |
โ | MiniMax T2A |
| Music / BGM | MiniMax music | (Suno when gateway channel available) | โ |
- Why split: the primary gateway carries the newest top-tier models; the supplement gateway backfills capabilities (TTS / MJ / Kling) and catches overflow when the primary runs out of credits.
- v6.8 โ repointed primary LLM/video/image to the funded gateway with the strongest models, fixing a video-stage
429 upstream-saturatederror on the old gateway. - v6.9 โ added a dedicated TTS provider (
lib/tts-providers/vectorengine-tts.ts) so voiceover works without per-vendor group-id config; enabled Midjourney as an image fallback; surfaced per-gateway usage + balance on the API Health Board. - Swap any of it in
.env.local(OPENAI_*/VEO_*/IMAGE_MODEL/MINIMAX_*) โ zero code change. Seedocs/llm-providers.md.
# 1. clone + install
git clone https://github.com/ChrisChen667788/wind-comic.git
cd wind-comic
npm install
# 2. configure (3 mandatory lines, see docs/llm-providers.md for swaps)
cp .env.example .env.local
# Edit .env.local:
# OPENAI_API_KEY=sk-...
# OPENAI_BASE_URL=https://api.openai.com/v1 # or any compat provider
# OPENAI_MODEL=gpt-4o # or claude-opus-4 via OpenRouter, etc.
# 3. run
npm run dev # Next.js on :3000
# Optional second terminal for real-time collab:
npm run dev:ws # Yjs WebSocket server on :1234
# 4. open http://localhost:3000 and create your first short filmMinimum LLM: any model โฅ24B parameters that responds in JSON. We've tested gpt-4o, Claude Opus 4, DeepSeek-r1, Qwen-Max, MiniMax-M2, GLM-4.5, Kimi-K2.
Optional engines (graceful fallback when missing):
MINIMAX_API_KEYโ image-01 / Hailuo-2.3 video / speech-2.8-hd TTS / music-2.6 BGMKELING_API_KEYโ Kling Master 4K + first-last-frame fusion + lip-syncVIDU_API_KEYโ Vidu Q3 (long-form 16s clips)VEO_API_KEYโ Veo 3.1-fast video fallbackSYNCSO_API_KEY/HAILUO_API_KEYโ alternative lip-sync providers
We're open to PRs. Two things matter most:
- Don't break the multi-agent contracts. Each agent has explicit input/output shapes โ see
types/agents.ts. - Tests gate everything. Vitest 1857/1857 must stay green. Add tests for new lib/service files.
See CLAUDE.md for the repo's "house style" + agent design notes.
docs/llm-providers.mdโ Swap LLM provider in 3 env varsdocs/SCREENSHOTS.mdโ Module-by-module screenshot manifestdocs/MARKETING-en.mdยทdocs/MARKETING-zh.mdโ Pitch deck copyROADMAP.mdโ Full sprint-by-sprint changelog (v2.10 โ v9.0.2b) ยทVERSIONS.mdโ version history tabledocs/COMPETITIVE-GAP-2026-05.mdโ Honest analysis vs Sora/Kling/Vidu/Higgsfield
MIT. Use it, fork it, build a startup on it. We just ask: if you ship a feature on top, send a PR back.
Built with โค๏ธ by people who believe AI-generated drama should feel like a show, not a tech demo.
โญ Star us if Wind Comic saved you a week.





















