Skip to content

docs: add connector libraries overview table to package README - #17939

Open
shuoweil wants to merge 21 commits into
mainfrom
shuowei-update-cloud-bigquery-readme
Open

docs: add connector libraries overview table to package README#17939
shuoweil wants to merge 21 commits into
mainfrom
shuowei-update-cloud-bigquery-readme

Conversation

@shuoweil

Copy link
Copy Markdown
Contributor

The google-cloud-bigquery reference page serves as the package README. Adding a connector libraries table guides users seeking DataFrame operations to high-level BigQuery libraries.

Changes

  • Added a Related Libraries section to packages/google-cloud-bigquery/README.rst.
  • Linked and described key ecosystem connectors:
    • BigQuery DataFrames (bigframes): Scalable pandas-like and scikit-learn-like API powered by BigQuery.
    • pandas-gbq: Lightweight integration for read_gbq() and to_gbq().

Fixes #<522853190> 🦕

shuoweil and others added 18 commits July 29, 2026 21:42
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@shuoweil shuoweil self-assigned this Jul 30, 2026
@shuoweil
shuoweil requested review from a team as code owners July 30, 2026 01:16
@shuoweil
shuoweil requested review from tswast and removed request for a team July 30, 2026 01:16

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request deprecates retrieving Arrow record batches directly via google-cloud-bigquery-storage, delegating this functionality to a new arrow module in pandas-gbq. It also adds related documentation and updates tests. The review feedback identifies two important issues in the new pandas_gbq/arrow.py file: a potential AttributeError when accessing arrow_record_batch if it is None, and an invalid attribute access on pyarrow.ipc.Message, which does not possess a schema attribute.

Comment thread packages/pandas-gbq/pandas_gbq/arrow.py Outdated
Comment thread packages/pandas-gbq/pandas_gbq/arrow.py Outdated
Comment on lines +43 to +47
batch_schema = (
arrow_schema
if arrow_schema is not None
else getattr(msg, "schema", pa.schema([]))
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

A pyarrow.ipc.Message object does not have a schema attribute, so getattr(msg, "schema", ...) will always fall back to the default value. Since we cannot retrieve the schema from the message itself in this context, we should simplify this to use arrow_schema directly if available, or fall back to an empty schema.

        batch_schema = arrow_schema if arrow_schema is not None else pa.schema([])

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

shuoweil and others added 2 commits July 29, 2026 18:28
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@shuoweil
shuoweil requested a review from sycai July 30, 2026 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant