macOS: align background computer use with the signed Codex helper - #5
Open
cm2435-hcomp wants to merge 2 commits into
Open
macOS: align background computer use with the signed Codex helper#5cm2435-hcomp wants to merge 2 commits into
cm2435-hcomp wants to merge 2 commits into
Conversation
Linux visual regression artifactsMatrix jobs now run independently. Download visual artifacts from this workflow run.
|
cm2435-hcomp
marked this pull request as ready for review
July 31, 2026 08:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Ports the recoverable native posture from the installed signed Codex macOS
helper into the Rust v2 driver, while keeping the existing typed controller
and evidence model.
We inspected the signed
SkyComputerUseServicebinary and recovered concretemechanisms including per-application synthetic focus enforcement, CPS
keyFocusReturned, PID-targeted window-stamped CoreGraphics events, live AXactions, ScreenCaptureKit window capture, menu lifecycle handling, and
element-sized page scrolling. Static inspection was used to form hypotheses;
real-host differentials decided behavior.
What changed
windows
evidence
scroll without hardware cursor movement
matching the signed helper
AXSelectedancestors, andAXOpenwhere exposed
windows from live facts
controller
signed-compatible targeted route
Why
The previous implementation made support decisions from framework labels and
per-window focus leases. That diverged from the signed helper and failed when
productive actions replaced the working window, especially in Finder. The
signed posture is app-controller state plus current window facts, with
special-framework behavior kept behind concrete native recipes.
Real-host validation
The paired Python facade/QA branch drove five real apps for five consecutive
valid repetitions each: 25 repetitions and 245 actions. Calculator, TextEdit,
Spotify, Chromium, and Finder all completed without the target becoming
frontmost, without an unallowed target becoming topmost, and without a
hardware-cursor warp attempt.
Finder's safe item drag had no filesystem effect in either implementation.
This PR records that as signed-behavior parity, not productive Finder drag
support.
Automated checks
cargo test -p cua-driver-core -p platform-macos: 122 core unit tests, 27API contracts, 3 lifecycle tests, and 201 macOS tests passed
cargo build -p cua-driver: passedisolating known pre-existing repository lint classes
cargo fmt --all --checkremains blocked by a largepre-existing formatting baseline outside this diff
Known gaps
Controlled same-target
userIntervened, numeric wrapper extremes,minimized/off-Space targets, productive Finder item drag, Finder Command+Up,
and Windows/X11/Wayland providers remain unconfirmed.
Paired Python facade and live-matrix PR:
hcompai/cua-drivers#17.