ui-svelte,internal/server: add video generation API support (/v1/videos)

[dkruyt]

Summary

Adds video generation support to llama-swap: OpenAI/vLLM-omni-compatible
/v1/videos routing on the backend, capability metadata for /v1/models,
and a new "Video" tab in the Playground UI.

vLLM-omni video API reference: https://docs.vllm.ai/projects/vllm-omni/en/latest/serving/videos_api/

Backend

• Route POST /v1/videos and POST /v1/videos/sync (multipart, model in
  form field) the same way /v1/audio/transcriptions and
  /v1/images/edits are already routed.
• Route GET /v1/videos, GET /v1/videos/{video_id},
  GET /v1/videos/{video_id}/content, and DELETE /v1/videos/{video_id}
  via a required ?model= query param — job ids don't carry a model, so
  this follows the same convention /props already uses.
• Add "video" as a valid capabilities modality and derive
  video_understanding / video_generation / image_to_video /
  video_to_video flags for /v1/models, mirroring the existing
  image/audio capability derivation.
• No changes needed to multipart/model-extraction handling
  (internal/shared/http.go) — it only ever reads/rewrites the model
  field and passes every other field (and any uploaded file) through
  untouched, so arbitrary backend-specific fields already work.
• Update README.md and config.example.yaml docs.

Playground UI

• New "Video" tab (VideoInterface.svelte, videoApi.ts) with:
  • Sync and async generation modes (async polls job status to
    completion, with cancel support).
  • Model selector filtered by the new video capability flags.
  • Reference image/video upload for image-to-video and video-to-video.
  • Size/duration/FPS controls covering the OpenAI-style baseline fields
    (size, seconds, fps) most backends are likely to honor.
  • An optional negative prompt field.
  • A collapsible Advanced parameters JSON box that flattens
    arbitrary backend-specific fields onto the request (e.g. vLLM-omni's
    width/height/num_frames/seed/extra_params), so the UI isn't
    limited to one backend's field names — advanced values override
    same-named basic fields, and model can never be overridden this way.
• Result rendering via a native <video controls> element with
  blob-URL playback and download.

fix: #990

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: c1e9d3d0-3994-42fc-a145-2153125ac68b

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[greptile-apps]

Greptile Summary

Adds video capability metadata, model-dispatched video API routes, and a Playground interface supporting synchronous and asynchronous generation.

• Extends model modalities and derived capability flags for video understanding and generation.
• Proxies multipart creation and query-dispatched status, content, and deletion endpoints.
• Adds video generation controls, polling, uploads, playback, download, and backend-specific advanced parameters.

Confidence Score: 4/5

The DELETE routing defect should be fixed before merging because video job deletion fails to forward rewritten backend model IDs for aliases and selectors.

The new DELETE endpoint enters routing paths that rewrite model identities, but the shared rewriter updates URL parameters only for GET and therefore forwards the original public model ID to the video backend.

Files Needing Attention: internal/server/server.go and internal/shared/http.go

Important Files Changed

Filename	Overview
internal/server/server.go	Registers video POST, GET, and DELETE routes; the DELETE route exposes incompatible query-model rewriting for aliased or selected models.
internal/shared/http.go	Unchanged request-rewrite logic is newly exercised by DELETE routing and rewrites the body rather than the model query parameter.
ui-svelte/src/lib/videoApi.ts	Implements multipart creation, polling, content retrieval, and deletion with encoded model/job parameters; no independently publishable client defect was established.
ui-svelte/src/components/playground/VideoInterface.svelte	Adds the video generation interface and follows existing Playground component and store patterns.
internal/server/api.go	Derives video capability flags consistently from configured input and output modalities.
internal/config/model_config.go	Adds video to validated model modalities with corresponding schema and tests.

_{Reviews (1): Last reviewed commit: "config-schema.json: add "video" to capab..." | Re-trigger Greptile}