Add bounded external KV-Ground compatibility smoke - #40
Draft
mark-e-deyoung wants to merge 5 commits into
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Implements the public-safe harness portion of #39 so opportunistic third-party/shared GPU capacity can falsify one concrete runtime assumption without becoming an MVP dependency.
Exact experiment
The harness pins:
vocaela/KV-Ground-8B-BaseGuiOwl1.5-0315;fe7563292bb52ab6c235fc3c87157e6a14017479;Click the TARGET button.It tests the legacy-equivalent
AutoModelForCausalLMpath first. If that fails, the same environment can run the public evaluation repo'sAutoModelForImageTextToTextpath. This distinguishes a bounded legacy-loader incompatibility from a broader environment/model failure without silently changingdesktop-ui-cv#35.Included
experiments/kv_ground_external_smoke.py— portable contract-only/GPU smoke harness with canonical machine-readable receipts;experiments/tests/test_issue_39_external_smoke.py— stdlib-only contract/parser/repeatability tests;.github/workflows/issue-39-external-smoke-contract.yml— public Actions validation only; no model/GPU/provider access;docs/experiments/issue-39-external-kv-ground-smoke.md— execution order, interpretation, safety and non-qualification boundary.Evidence boundary
The receipt may contain public/synthetic model output and environment facts. It intentionally has no private screenshots, target inventory, provider credentials, host traceback,
desktop-ui-cvsource, or WineBot material.This PR does not establish:
The actual GPU execution remains opportunistic. If platform friction exceeds uncertainty reduction, #39 can stop without blocking the authoritative path.
Critical-path relationship
This remains parallel and nonblocking to:
exact identity -> exact provider-native materialization -> frozen request/target/envelope -> desktop-ui-cv #35 local handle -> private holdout + target resource measurement -> qualification receipt -> deterministic repeat -> one-material-change falsification -> GO/NARROW/KILLVerification
The PR's public workflow validates the harness contract and byte-repeatable
--contract-onlyoutput using only Python 3.12 and the standard library. It deliberately does not download model weights or request GPU capacity.Stacked on the current Foundry control realignment branch from draft PR #22; retarget only when prerequisite control state lands.
Related: #18, #39;
SemperSupra/desktop-ui-cv#35.