Skip to content
View jhonatangs's full-sized avatar
5 followers · 15 following

Achievements

Achievement: Pull Shark

Achievements

Achievement: Pull Shark

Highlights

  • Pro

Block or report jhonatangs

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
jhonatangs/README.md

👋 Hello, I'm Jhonatan

A Data & Software Engineer with a B.S. in Computer Science (UFOP), focused on building scalable ETL/ELT pipelines, robust backend systems, and deterministic AI-assisted workflows. With production experience across AWS and GCP environments, I bridge data engineering, machine learning, and DevOps to deliver reliable, high-impact data products.

🚀 Core Tech Stack

  • Languages: Python, SQL, TypeScript, Bash.
  • Data Engineering: Apache Airflow, dbt, Apache Spark, DuckDB, MongoDB, Medallion Architecture.
  • Cloud Platforms: AWS (Redshift, Lambda, S3, Glue, SQS), GCP (BigQuery, GCS).
  • Software Engineering & AI: FastAPI, Next.js, Autonomous Agents, RAG Systems, Scikit-learn, NLP (SciBERT).
  • DevOps & Infra: Terraform, Docker, GitHub Actions (CI/CD), Arch Linux (WSL).

🏢 Professional Experience

  • Data Engineer / DevOps @ Beegol: Automated CI/CD pipelines via GitHub Actions, architected data schema validations using Pandera, and maintained high-availability data ingestion infrastructure.
  • Data Engineer @ Booster / Rabbot: Designed and orchestrated complex ETL/ELT pipelines using Airflow and dbt across AWS (Redshift) and GCP (BigQuery), integrating relational and NoSQL (MongoDB) sources.
  • Previous Roles: Data Engineering Intern @ Media.Monks (GCP pipelines & Airflow) and Data Intern @ Enacom Group (Machine Learning PoCs & EDA).

💼 Featured Projects

⚙️ Data Engineering & Cloud Architecture

  • Pokémon AI Lakehouse & ML Pipeline: A comprehensive multi-layer lakehouse featuring automated DLT ingestion, PySpark processing, and scikit-learn model serving.
  • Olist Lakehouse: Robust cloud infrastructure managed via Terraform (VPC, EC2, RDS, AWS DMS) paired with PySpark Iceberg merges for advanced data modeling.
  • Financial Lake Serverless: A cloud-native, event-driven data lake built on AWS (Lambda, SQS, S3, Glue) and entirely provisioned via Terraform for real-time financial tracking.
  • Brasileirão 2026 Pipeline: An end-to-end system combining custom Python web scraping, Apache Airflow orchestration, and dbt models for sports analytics.

🤖 Software Engineering & AI Systems

  • TalkDoc: A modular Retrieval-Augmented Generation (RAG) application demonstrating full-stack engineering, combining a Next.js frontend with a robust FastAPI backend for context-aware document interactions.
  • AI-Assisted Development Infrastructure: A strictly parameterized Zsh router (zsh-ai-workflow) and an architectural template designed to orchestrate autonomous AI agents and manage cross-agent context handoffs directly from the terminal.

🧠 Machine Learning & Research

  • SLSDT: A published, scikit-learn compatible Python package for inducing oblique decision trees using Stochastic Local Search (LAHC).
  • SciSci-BERT: Academic research applying SciBERT language models and HDBSCAN clustering for semantic space validation and collaboration network analysis in Brazilian scientific publications.

📫 Connect

Feel free to explore my repositories or reach out for engineering collaborations. I am always open to discussing complex challenges across Data Engineering, AI/ML systems, and Software Architecture.

Pinned Loading

  1. slsdt slsdt Public

    A Python package for inducing Oblique Decision Trees using Stochastic Local Search, specifically the Late Acceptance Hill-Climbing (LAHC) algorithm.

    Python 3 1

  2. pokemon-ai-lakehouse-ml-pipeline pokemon-ai-lakehouse-ml-pipeline Public

    End-to-end Data Engineering & ML Lakehouse. Extracts PokéAPI data via Medallion Architecture (PySpark/Airflow) to train and serve a Pokémon type classifier using FastAPI.

    Python

  3. scisci-bert scisci-bert Public

    Mapping the Brazilian Computer Science scientific network. An end-to-end Data Science pipeline applying NLP (SciBERT), OpenAlex API, and Network Analysis to uncover collaboration patterns.

    Python

  4. data-agent data-agent Public

    An autonomous Data Engineering AI agent built from scratch in Python using the ReAct pattern for dynamic SQL generation and data exploration.

    Python

  5. airflow-docs-agent airflow-docs-agent Public

    An AI-powered RAG agent acting as an Apache Airflow expert. Built with a custom ETL pipeline, LangChain semantic chunking, local FastEmbed models, and Qdrant vector database.

    Python

  6. brasileirao-pipeline brasileirao-pipeline Public

    ⚽ Data Lakehouse Esportivo (Brasileirão 2026). Pipeline End-to-End com Airflow, dbt, DuckDB e um Agente de IA (NL2SQL) com memória e busca web.

    Python