Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

hoangsonww/End-to-End-Data-Pipeline

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.

Owner
hoangsonww (personal account)
Stars
Stars: 144
Forks
Forks: 67
Language
Python
License
MIT
Created
2025
Topics
airflowapachedockerelasticsearchflinkgrafanagreat-expectationshadoopinfluxdbkafka
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by hoangsonww

All 3 repos by hoangsonww

Nearby in Python

All Python repos