Feature: Kafka CI Workflows

[luinor223]

Summary

This PR introduces a comprehensive GitHub Actions CI/CD pipeline for Kafka CDC data pipeline, providing automated testing, security scanning, and deployment capabilities for Kafka Connect components.

---

Key Features

• Automated linting for YAML and JSON configuration files
• Security scanning with Trivy vulnerability detection
• Multi-platform Docker builds (AMD64/ARM64) pushed to GitHub Container Registry
• Integration testing with live Kafka Connect services
• Connector validation to ensure configurations are correct

---

Changes

List all major changes in this PR:

• Added ./.github/workflows/kafka-ci.yml
• Modified docker-compose.yml to pass linting validation

---

Github Actions workflow

1. Lint Job

• Validates YAML syntax for docker-compose.yml and workflow files
• Checks JSON syntax for all Kafka connector configurations
• Verifies Docker Compose configuration validity

2. Security Job

• Runs Trivy filesystem vulnerability scanning
• Uploads SARIF results to GitHub Security tab
• Identifies security issues in dependencies and configurations

3. Build Job

• Multi-platform Docker image builds (AMD64 + ARM64)
• Pushes images to GitHub Container Registry (ghcr.io)
• Uses layer caching for faster builds
• Generates proper image tags (branch, PR, SHA, latest)

4. Test Job

• Spins up integration test environment with PostgreSQL, Kafka, Schema Registry, and MinIO
• Tests the built Kafka Connect image in a real environment
• Validates that required connector plugins are installed
• Tests connector configuration validation endpoints
• Ensures connectors can be properly configured

[github-advanced-security]

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

[thuythanh04]

peach

[luinor223]

peach

love you