Kestra

Kestra is an open-source, event-driven orchestration platform for data, AI, and infrastructure workflows. It unifies scheduled and real-time automation behind a declarative, language-agnostic interface, so you can build reliable pipelines in a few lines of YAML directly from the UI.

Workflows live as code with Git version control, a built-in code editor, syntax highlighting, auto-completion, and real-time validation. Flows combine triggers, namespaces, subflows, retries, timeouts, error handling, inputs and outputs, conditional branching, backfills, and sequential or parallel tasks. A rich plugin ecosystem runs scripts in Python, Node.js, R, Go, Shell, and more, and can launch Docker containers or Kubernetes jobs for heavy workloads.

Kestra runs locally with Docker and has deployment paths for Docker Compose, Podman, Kubernetes, AWS, GCP, and Azure. Because orchestration logic is always managed declaratively in code, changes made from the UI, API, CI/CD, or Terraform stay in sync.