GitHunt
SA

sanderploegsma/beam-scheduling-kubernetes

Scheduled Dataflow pipelines using Kubernetes Cronjobs

Scheduled Apache Beam jobs using Kubernetes Cronjobs

Prerequisites

  • Kubernetes cluster version >= 1.8
  • Docker (optional, only needed when building your own image)
  • Java (optional, only needed to run the application on your own machine)

Setting up

Deploy the Kubernetes Cronjob using

kubectl apply -f kubernetes/cronjob.yml

Contributors

Created February 15, 2018
Updated September 16, 2020