poll BigQuery matchers on missing tables

[aIbrahiim]

Fixes: #30760
PostCommit Python Arm streaming tests were failing because the BigQuery table does not exist until the first insert and the matcher already had a timeout, but a 404 stopped the query after a few retries, so that wait never ran

This keeps polling while the table is missing, until the timeout that was already configured. A 404 with no timeout still fails immediately and I checked the matcher unit tests locally

[codecov]

Codecov Report

❌ Patch coverage is 93.75000% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 79.90%. Comparing base (76f6e6d) to head (5498fdb).
⚠️ Report is 178 commits behind head on master.

Files with missing lines	Patch %	Lines
...ython/apache_beam/io/gcp/tests/bigquery_matcher.py	93.75%	1 Missing ⚠️

Additional details and impacted files

@@              Coverage Diff              @@
##             master   #40559       +/-   ##
=============================================
+ Coverage     56.16%   79.90%   +23.74%     
=============================================
  Files          1124      488      -636     
  Lines        178336    82397    -95939     
  Branches       1489        0     -1489     
=============================================
- Hits         100170    65843    -34327     
+ Misses        75645    16554    -59091     
+ Partials       2521        0     -2521     

Flag	Coverage Δ
go	?
java	?
python	79.90% <93.75%> (+0.35%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[github-actions]

Assigning reviewers:

R: @claudevdm for label python.
Backup reviewer: jrmccluskey (if the main reviewer is unresponsive, you can escalate to them by tagging their username)

Note: If you would like to opt out of this review, comment assign to next reviewer.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[Abacn]

Thanks for root causing it. There is no change on bigquery_matcher.py recently, is it caused by a offending Beam PR? If not, what time this breakage started happen (which then suggest a BigQuery service breaking change)

[aIbrahiim]

Thanks for root causing it. There is no change on bigquery_matcher.py recently, is it caused by a offending Beam PR? If not, what time this breakage started happen (which then suggest a BigQuery service breaking change)

No, bigquery_matcher.py did not change recently and the last edit before this was formatting only

It also did not start at one specific time and the same test still passes on some runs and fails on others, so it does not look like a BigQuery breaking change

[Abacn]

Thanks!