Docker, Kubernetes & Cloud Task Runners Explained
For the complete documentation index, see llms.txt. For a full content snapshot, see llms-full.txt. Append.mdto anykestra.io/docs/*URL for plain Markdown.
Choose a task runner to control where and how Kestra executes your script tasks.
| Task runner | Edition | Description |
|---|---|---|
| Process | OSS | Runs tasks as local processes on the Kestra worker |
| Docker | OSS | Runs tasks in Docker containers (default) |
| Kubernetes | EE | Runs tasks as Kubernetes pods |
| AWS Batch | EE | Runs tasks on AWS Batch (ECS Fargate, EC2, or EKS) |
| AWS EC2 | EE | Runs tasks natively on EC2 instances via SSM — for GPU workloads, licensed software, and Spot instances |
| Azure Batch | EE | Runs tasks on Azure Batch containers |
| Azure Virtual Machine | EE | Runs tasks natively on Azure VMs via the Run Command API — no SSH, no container |
| Google Batch | EE | Runs tasks on Google Cloud Batch VMs |
| Google Compute Engine | EE | Runs tasks natively on Compute Engine VMs via startup-script — no SSH, no IAP tunnel |
| Google Cloud Run | EE | Runs tasks as serverless Google Cloud Run jobs |
Process and Docker are open-source and built into Kestra. Cloud-based runners require an Enterprise Edition license.
Process Task Runner
Run tasks as local processes on the worker node for fast execution without container overhead.
Docker Task Runner
Isolate task execution in Docker containers using Kestra's Docker Task Runner for consistent environments.
Kubernetes Task Runner
Run tasks as Kubernetes pods. Configure pod templates, namespaces, and resource limits for container-based execution.
AWS Batch Task Runner
Execute tasks as AWS Batch jobs on ECS Fargate, EC2, or EKS for scalable and serverless compute.
AWS EC2 Task Runner
Execute tasks natively on AWS EC2 instances via SSM Run Command — ideal for GPU workloads, licensed software, and Spot instance cost optimization.
Azure Batch Task Runner
Offload tasks to Azure Batch to run large-scale parallel and high-performance computing applications efficiently.
Azure Virtual Machine Task Runner
Execute tasks natively on Azure VMs via the Azure Run Command API — no SSH, no container runtime, and no public IP required.
Google Batch Task Runner
Execute tasks using Google Batch to provision and manage compute resources on Google Cloud efficiently.
Google Compute Engine Task Runner
Run Kestra script tasks directly on Compute Engine VMs — no SSH, no IAP tunnel. The script runs as the instance's startup-script; logs stream from the serial console.
Google Cloud Run Task Runner
Run tasks as serverless containers on Google Cloud Run for scalable and managed execution.
Huawei Cloud CCI Task Runner
Run tasks as bare Pods on Huawei Cloud CCI (Cloud Container Instance) for serverless, scalable container execution.
Was this page helpful?