AlphaUncommon
airscholar/e2e-data-engineering
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
- Owner
- airscholar (personal account)
- Stars
- Stars: 370
- Forks
- Forks: 159
- Language
- Python
- License
- None
- Created
- 2023
- Topics
- apache-airflowapache-kafkaapache-sparkapache-zookeeperbig-datacassandracontainerizationdata-engineeringdata-pipelinedata-processing
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by airscholar
All 2 repos by airscholar- airscholar/RedditDataEngineeringStars: 229PythonPrototype
Nearby in Python
All Python repos- Socialpranker/deepdiveStars: 370PythonAlpha
- Moh4696/300-free-resource-websitesStars: 370PythonAlpha
- Weistrass/DyRefStars: 370PythonAlpha
- enaeseth/python-fp-growthStars: 370PythonAlpha
- uskudnik/amazon-glacier-cmd-interfaceStars: 370PythonAlpha
- powerline/fontpatcherStars: 370PythonAlpha