Skip to content
ZieglerAaronPublic
forked from hnawaz007/datalake

About

Testing Apache Iceberg and Delta Lake for Airports

Resources

Stars

0 stars

Watchers

0 watching

Forks

 
 

Latest commit

 

History

14 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

Trino with Iceberg, Postgres, and MinIO

This is the datalake setup using Trino with an Iceberg connector, Postgres as metastore, and MinIO for object storage.

Start everything up:

docker-compose up

Connect to the Trino controller to execute some SQL:

docker-compose exec controller trino

Stop and remove the containers and network:

docker-compose down

Airflow Setup

We build a custom image for Airflow. Dockerfile and docker-compose.yml file are available in this repo.

To build the image:

docker build -t airflow-trino -f Dockerfile . --no-cache

Start everything up:

docker-compose up -d

About

Testing Apache Iceberg and Delta Lake for Airports

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages