Skip to content

test(suite): reorganize manual release tests to match the new SW team structure - #32193

Open
honzauher wants to merge 1 commit into
developfrom
manual-release-tests-redistribution
Open

test(suite): reorganize manual release tests to match the new SW team structure#32193
honzauher wants to merge 1 commit into
developfrom
manual-release-tests-redistribution

Conversation

@honzauher

@honzauher honzauher commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Description

Follow-up on manual release tests after #31987 landed. That PR already assigned a
stream to every test and made it mandatory via typing and lint, so the stream
reassignment this PR originally carried is gone — everything here is what #31987
did not cover. Rebased on develop; 26 files.

Manual steps brought up to date — the app had moved on and the steps no longer
matched it:

  • "Speed up" is a button on the pending transaction row, not "bump fee" inside the
    detail modal, and "Cancel transaction" sits next to it.
  • "Send all" is a "Send max" switch in the amount field.
  • Factory reset uses two sequential step cards confirmed with "I understand",
    not two tick boxes.
  • Tor is a quick action in the left sidebar, not a button in the top right, and it
    is desktop-only.
  • The QR scan icon in the Send form is always visible; no hover needed.
  • remember-wallet rewritten for the eject model — the "remember wallet" switch is
    gone, wallets persist by default and are ejected.
  • check-update and application-reset assertions widened to what the code
    actually does (button states, autostart, IndexedDB, remembered wallets).
  • metadata/labels had "Define me please." as its only step; now covers the Suite
    Sync labelling flows on Windows/macOS, where the automated suite does not run.

Deleted

  • btc/btc-transactions — duplicated account/transactions "Speed up and cancel a
    pending transaction"; its one unique step (pending tx visible in both accounts)
    was moved there.
  • dashboard/portfolio — subset of dashboard-wallet "Portfolio graph".
  • settings/wallet-loading — the "Wallet loading" section no longer exists in
    Settings/Device.

Added — six tests for areas with no coverage at all, manual or automated:

Test Stream Cases
account/named-address — ENS resolution Network 2
connect/bluetooth-pairing — Bluetooth/THP lifecycle Connect 2
settings/pin-and-wipe-code Firmware 2
settings/safety-checks — Strict vs Prompt Firmware 2
settings/bio-auth — Touch ID / Windows Hello Wallet 2
settings/forget-device — all five flow branches Growth 5

Other

  • MacOSIntel dropped from every osMatrix except auto-update, where the Mac
    architecture genuinely matters for install and code signing.
  • Coinjoin reduced to a single "Discovery of a coinjoin account" test, on Connect
    per the scope doc's "Coinjoin acc." ownership.
  • A few network-specific cases moved to Network: message signing, custom
    backend/explorer, Tron energy, Stellar token activation, coin-specific send.

Notes for QA

Three of the new tests need a look before they go into the release round:

  • pin-and-wipe-code — the second case erases the device, since that is the
    only way to verify a wipe code. Needs a disposable seed and a deliberate
    decision about including it.
  • safety-checks — the second case does not yet name a concrete action that Strict
    refuses and Prompt allows. Written generically; please fill it in.
  • metadata/labels — the previous steps were a placeholder, so the new ones are my
    reading of the note that the coverage is automated on Linux only. Please
    sanity-check them against what actually needs re-running off Linux.

account/named-address covers Suite only. Develop now also resolves ENS names in
the suite-native send form, so the same gap exists on mobile and is not addressed
here.

Related Issue

Resolve

Screenshots:

🌐 Preview deployments

🌐 Suite Web preview: https://dev.suite.sldev.cz/suite-web/manual-release-tests-redistribution/web/

🔍 Currents Test Results

🔍 Suite desktop test results: View in Currents

🔍 Suite web test results: View in Currents

🔒 Quarantined E2E Tests

Trezor Suite (web) — 3 test(s)
Test Type
Staking - Cardano > Stake Cardano 🤖 auto
Trading - Swap > Swap SOL USDT token to ETH 🤖 auto
Trading - Swap coin to token > Swap Solana to USDC 🤖 auto

Updated: 2026-09-08T13:55:12.777Z • 3 test(s) total

Trezor Suite (desktop) — 5 test(s)
Test Type
Trading - Sell BTC > Sell Bitcoin for best offer 🤖 auto
Staking - Cardano > Stake Cardano 🤖 auto
Suite Sync - Update and Remove Labels > Update and remove labels syncs correctly to relay 🤖 auto
Quarantine test: "Suite Sync - Quota Manager top-up,Exceeded wallet limit is topped up from the device pool" 🙋 manual
Trading - Swap > Swap SOL USDT token to ETH 🤖 auto

Updated: 2026-09-08T13:54:45.392Z • 5 test(s) total

@honzauher honzauher self-assigned this Sep 7, 2026
@honzauher
honzauher requested a review from Vere-Grey as a code owner September 7, 2026 16:03
@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown

⚡️ Performance report (alpha)

Note

Alpha release: The limits are still being calibrated, and each measurement is
usually a single run on a shared CI runner, so expect noise between runs. Treat a
number as a hint to look closer, not as a verdict.

desktop / group 4

🟢 Within limits.

Each metric reads measured/limit (% of limit).

Scenario TBT Long tasks Longest task React commits Interaction
multi-account-discovery [T3W1] 571/7000 ms
(8 %)
24/100
(24 %)
233/800 ms
(29 %)
246/400
(62 %)
6150 ms

desktop / group 3

🟢 Within limits.

Each metric reads measured/limit (% of limit).

Scenario TBT Long tasks Longest task React commits Interaction
account-switch [T3W1] 265/700 ms
(38 %)
2/5
(40 %)
280/700 ms
(40 %)
32/80
(40 %)
673 ms
wallet-discovery [T3W1] 584/2000 ms
(29 %)
21/45
(47 %)
181/400 ms
(45 %)
239/410
(58 %)
7031 ms

@honzauher
honzauher force-pushed the manual-release-tests-redistribution branch from 2a72f40 to c87491e Compare September 8, 2026 11:31
@honzauher
honzauher force-pushed the manual-release-tests-redistribution branch from c87491e to 8b2c9cf Compare September 8, 2026 13:49
@honzauher
honzauher requested a review from Ondra-Zik September 8, 2026 14:46

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will change my test cases when needed drop this please

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here I will change my test cases when needed drop this please

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants