2 items tagged with "batch"
A scalable batch ETL platform on Apache Spark running on Kubernetes, transforming large datasets from object storage into curated tables.
Classic big-data batch pattern: Apache Airflow orchestrates scheduled DAGs that run distributed Apache Spark jobs over data-lake storage.