The documentation is very confusing and could not get a simple suite running

[rvishureddy]

All i am trying to do is run a local test case
Connect to redshift given a database and table name just run if that table has any null values in a particular column or in all columns whichever is easy.

Create a context (My case is everything is local)

Import great_expectations and request a Data Context.

import great_expectations as gx

context = gx.get_context(mode="file")

Optional. Request a File Data Context from a specific folder.

context = gx.get_context(mode="file", project_root_dir="./")

Optional. Review the configuration of the returned File Data Context.

print(context)

Created a file context and added connection string in the config_variable.yml file

Then ran the code given in the connect to sql

import great_expectations as gx

context = gx.get_context()

Set up: Create a Data Source

datasource_name = "redshift_sand"

my_connection_string = "${REDSHIFT_CONNECTION_STRING}"

datasource = context.sources.add_sql(name="redshift_sand", connection_string="${REDSHIFT_CONNECTION_STRING}")

print(context.data_sources.get(datasource_name))

asset_name = ""

asset_table_name = ""

table_asset = datasource.add_table_asset(name=asset_name, table_name=asset_table_name)

The above code gives ton of errors.

[joshua-stauffer]

Hi @rvishureddy, sorry for the rough start here — thanks for sticking with it. Two things will most likely unblock you:

1. API version mismatch. context.sources.add_sql(...) is the older 0.18 API. On GX 1.x (current) the namespace changed to context.data_sources, and there's a dedicated Redshift helper. If you followed a mix of 0.18 and 1.x docs, that alone would generate a cascade of errors.

A minimal end-to-end version of what you're describing on 1.x looks like:

import great_expectations as gx

context = gx.get_context(mode="file")

ds = context.data_sources.add_redshift(
    name="redshift_sand",
    connection_string="${REDSHIFT_CONNECTION_STRING}",
)
asset = ds.add_table_asset(name="my_table", table_name="my_table")
batch_def = asset.add_batch_definition_whole_table("whole_table")

batch = batch_def.get_batch()
result = batch.validate(
    gx.expectations.ExpectColumnValuesToNotBeNull(column="my_column")
)
print(result)

2. To dig into the actual errors, could you share:

• GX version
• the full traceback

That'll tell us whether it's the API namespace, a missing Redshift driver (pip install "great_expectations[redshift]"), or the connection string itself.

[joshua-stauffer]

hey @rvishureddy , closing this for now, as this question is over a year old. Sorry it took so long to get you a response - feel free to open another if it's helpful.