[12/12] build+ci+docs: installer repackage, qualification scripts, CI workflow, docs rewrite - #21
Conversation
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Pull request overview
This PR finalizes the Windows-native pipeline by repackaging the release artifacts around the native sherpa-onnx runtime (no Python/venv/worker), adding human/automated qualification scripts and a first Windows CI workflow, and rewriting docs to reflect the native runtime + qualification gates.
Changes:
- Repackages the ZIP/installer payload and adds package QA to enforce “no Python” + native runtime integrity.
- Adds PowerShell qualification/benchmark harnesses for dictation, meeting lifecycle, media import, and release gating.
- Introduces a Windows GitHub Actions workflow to build/test/package and smoke-test the produced ZIP; refreshes docs/READMEs accordingly.
Reviewed changes
Copilot reviewed 34 out of 34 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
.github/workflows/windows-ci.yml |
Adds Windows CI job: restore/build/test, PS syntax validation, package + smoke-test ZIP. |
README.md |
Rewrites top-level README for the native runtime + qualification approach (but still references the old ZIP name). |
windows-native/README.md |
Updates native app README with transcription model/role behavior and benchmark entrypoint. |
installers/muesli-windows.iss |
Repackages Inno Setup installer without the legacy Python-runtime setup task. |
scripts/package-windows-v1.ps1 |
Produces muesli-windows-0.2.0-*.zip, removes symbols, and copies release docs/scripts (missing copy step for privacy doc). |
scripts/test-windows-package.ps1 |
Expands ZIP QA to forbid Python-era artifacts, enforce runtime dependencies, and run --diagnose-native. |
scripts/fresh-machine-qa.ps1 |
Validates extracted/installed folder shape and rejects legacy artifacts. |
scripts/install-windows.ps1 |
Simplifies install flow (removes worker-runtime setup switches). |
scripts/uninstall-windows.ps1 |
Adds explicit, confirmed user-data removal options (-RemoveUserData, -ForceUserDataRemoval). |
scripts/install-parakeet-cuda-runtime.ps1 |
Installs CUDA/cuDNN dependency pack with pinned SHA-256 verification and safe extraction. |
scripts/smoke-transcription-models.ps1 |
Runs real-audio smoke tests across all seven offline model IDs. |
scripts/benchmark-native-transcription.ps1 |
Headless benchmark runner with determinism/latency/provider gates. |
scripts/benchmark-native-meeting.ps1 |
Headless meeting benchmark runner with ASR+diarization+merge gates. |
scripts/test-transcription-corpus.ps1 |
Validates and runs schema-driven dictation corpus qualification (WER/CER/latency/determinism). |
scripts/qualify-dictation-corpus.ps1 |
Wraps CPU+CUDA corpus qualification into a combined gate report. |
scripts/qualify-dictation-target.ps1 |
Produces a human-confirmed, trace-based dictation target qualification report. |
scripts/qualify-dictation-target-suite.ps1 |
Enforces coverage across Notepad/Chrome/Office/Other target reports. |
scripts/summarize-dictation-latency.ps1 |
Summarizes dictation latency traces and applies percentile gates. |
scripts/test-media-imports.ps1 |
Manifest-driven media import qualification runner (duration/latency/determinism and optional WER/CER). |
scripts/qualify-meeting-session-lifecycle.ps1 |
Checks human-reviewed meeting-session lifecycle evidence against required scenarios and privacy constraints. |
scripts/qualify-windows-release.ps1 |
End-to-end packaged release qualification (package QA + native stress + signature/log health evidence). |
scripts/sign-windows-release.ps1 |
Updates timestamp URL to HTTPS for signing. |
scripts/verify-phase12-ui.ps1 |
Adds a capture/manifest tool for Phase 12 visual verification matrix screenshots. |
docs/ROADMAP.md |
Updates roadmap to the native launch scope + next qualification steps. |
docs/WINDOWS_NATIVE_PLAN.md |
Replaces legacy Python-worker plan with the current native transcription platform description. |
docs/WINDOWS_V1_RELEASE.md |
Updates release checklist for 0.2.0 artifacts and the new qualification gates. |
docs/TRANSCRIPTION_BENCHMARKS.md |
Rewrites benchmarks doc to match native benchmark scripts + dictation latency traces. |
docs/PHASE2_DICTATION_QUALIFICATION.md |
Documents Phase 2 dictation qualification (human corpus + target apps + latency gates). |
docs/PHASE3_QUALIFICATION.md |
Documents Phase 3 meeting-session human qualification requirements + checker expectations. |
docs/PHASE4_MEETING_IMPORT_QUALIFICATION.md |
Documents Phase 4 meeting/import qualification and remaining format coverage caveats. |
docs/PHASE5_RELEASE_QUALIFICATION.md |
Documents Phase 5 packaged release qualification and evidence artifacts. |
docs/PHASE8_CONTEXT_TRANSFER.md |
Captures Phase 8 context/fixtures conventions and test gating variables. |
docs/WINDOWS_TRANSCRIPTION_MODELS.md |
Defines the Windows transcription model platform as the operational source of truth. |
docs/WINDOWS_STREAMING_ASR_INVESTIGATION.md |
Records Phase 4 streaming ASR feasibility and qualification evidence for Nemotron + Silero. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| ## Install | ||
|
|
||
| ## Development | ||
| Download and extract `muesli-windows-v1-win-x64.zip`, then run `Muesli.exe`. |
| Copy-Item -LiteralPath (Join-Path $PSScriptRoot "install-windows.ps1") -Destination (Join-Path $publishDir "install-windows.ps1") -Force | ||
| Copy-Item -LiteralPath (Join-Path $PSScriptRoot "uninstall-windows.ps1") -Destination (Join-Path $publishDir "uninstall-windows.ps1") -Force | ||
| Copy-Item -LiteralPath (Join-Path $PSScriptRoot "test-windows-package.ps1") -Destination (Join-Path $publishDir "test-windows-package.ps1") -Force | ||
| Copy-Item -LiteralPath (Join-Path $PSScriptRoot "fresh-machine-qa.ps1") -Destination (Join-Path $publishDir "fresh-machine-qa.ps1") -Force | ||
| Copy-Item -LiteralPath (Join-Path $PSScriptRoot "install-parakeet-cuda-runtime.ps1") -Destination (Join-Path $publishDir "install-parakeet-cuda-runtime.ps1") -Force | ||
| Copy-Item -LiteralPath (Join-Path $root "THIRD-PARTY-NOTICES.md") -Destination (Join-Path $publishDir "THIRD-PARTY-NOTICES.md") -Force | ||
| Copy-Item -LiteralPath (Join-Path $root "licenses") -Destination (Join-Path $publishDir "licenses") -Recurse -Force |
cf0c28f to
f81a32c
Compare
556d813 to
dd40b79
Compare
dd40b79 to
e43d92b
Compare
Wires the dashboard, dictation, meetings, model management, benchmarking, onboarding, computer-use and diagnostics surfaces onto the native services introduced in the preceding changes. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Drops the Python worker payload from the package, bundles the native runtime and license texts, and updates the Inno Setup script plus the install, uninstall, signing and package smoke-test scripts to match. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Adds scripts to smoke-test each catalogued model, install the Parakeet CUDA runtime, and benchmark native transcription and meeting throughput. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Runs dictation against a fixed corpus and per-target suites, and summarises latency percentiles for release sign-off. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
…cripts Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Builds Release, runs the hardware-free regression suite, validates PowerShell script syntax, and builds and smoke-tests the public win-x64 package on every pull request. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Updates the READMEs, roadmap, native plan, benchmark results and v1 release notes to describe the in-process sherpa-onnx pipeline that replaced the Python worker, and records the context-transfer notes. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
…t merge reapplication
e8c1778 to
ea78451
Compare
|
Claude encountered an error after 0s —— View job I'll analyze this and get back to you. |
This PR (12/12): installer repackage, qualification scripts, CI workflow, docs rewrite
Commits:
927f49cbuild: repackage the installer around the native runtime —installers/muesli-windows.iss,scripts/package-windows-v1.ps1,scripts/install-windows.ps1,scripts/uninstall-windows.ps16b5d00atest: model smoke tests and native runtime setup scripts —scripts/smoke-transcription-models.ps1,scripts/install-parakeet-cuda-runtime.ps166f0955test: dictation accuracy and latency qualification scripts —scripts/qualify-dictation-corpus.ps1,scripts/qualify-dictation-target.ps1,scripts/qualify-dictation-target-suite.ps1,scripts/summarize-dictation-latency.ps1,scripts/test-transcription-corpus.ps1c28fa90test: meeting lifecycle, media import and release qualification scripts —scripts/qualify-meeting-session-lifecycle.ps1,scripts/qualify-windows-release.ps1,scripts/test-media-imports.ps1,scripts/test-windows-package.ps1,scripts/fresh-machine-qa.ps1,scripts/sign-windows-release.ps1,scripts/verify-phase12-ui.ps1,scripts/benchmark-native-*.ps15350416ci: Windows build, test and package workflow —.github/workflows/windows-ci.yml8620e93docs: rewrite architecture docs for the native pipeline —README.md,windows-native/README.md,docs/(ROADMAP, WINDOWS_NATIVE_PLAN, WINDOWS_V1_RELEASE, TRANSCRIPTION_BENCHMARKS, qualification guides, PHASE8_CONTEXT_TRANSFER, WINDOWS_STREAMING_ASR_INVESTIGATION, WINDOWS_TRANSCRIPTION_MODELS)34 files, +3,325/−438.
Review focus
installers/muesli-windows.iss+scripts/package-windows-v1.ps1— native-runtime payload layout, CUDA runtime optional component, no Python anywhere in the package..github/workflows/windows-ci.yml— build → 484-test run → package chain; first real run happens on this PR.docs/ROADMAP.md+docs/WINDOWS_V1_RELEASE.md— the post-review plan, including the deferred items (D1/D3/D4/D5).Divergence note (see PR 1 for full context): after this stack was cut,
maindropped Inno Setup in favor of Velopack. This PR repackages Inno. The packaging end-state is the one open decision of this series and is deferred to merge time — Velopack would additionally deliver the real auto-updater (roadmap D5).Known limits
scripts/sign-windows-release.ps1is ready for when a cert is available.Test evidence
dotnet build windows-native\Muesli.Windows\Muesli.Windows.csproj --no-restore— cleandotnet test windows-native\Muesli.Windows.Tests\Muesli.Windows.Tests.csproj --no-restore— 484/484 passing (suite from PR 11)Previous: #20 | Next: — (tip of the stack)