Transform Filter
CertifiedFilter records
Transform Filter
Filter records
Keep or drop records based on a boolean expression.
type: io.kestra.plugin.transform.FilterExamples
Keep active customers
id: filter_active_customers
namespace: company.team
tasks:
- id: normalize
type: io.kestra.plugin.core.output.OutputValues
values:
records:
- customer_id: c1
is_active: true
total_spent: 120
- customer_id: c2
is_active: false
total_spent: 90
- id: filter
type: io.kestra.plugin.transform.Filter
from: "{{ outputs.normalize.values.records }}"
where: is_active && total_spent > 100
onError: SKIP
Properties
from *Requiredobject
Input records
Ion list or struct to transform, or a storage URI pointing to an Ion file.
where *Requiredstring
Filter expression
Expression evaluated on each record and required to return true or false.
onError string
FAILFAILSKIPKEEPOn error behavior
FAIL stops the task on expression errors, SKIP drops the current record, and KEEP emits the original record when the filter expression fails.
outputFormat string
TEXTTEXTBINARYOutput format
Experimental: TEXT or BINARY. Only transform tasks can read binary Ion. Use TEXT as the final step.
outputType string
AUTOAUTORECORDSSTOREOutput type
AUTO stores to internal storage when the input is a storage URI; otherwise it returns records.
pluginDefaultsRef Non-dynamicstring
Reference (ref) of the pluginDefaults to apply to this task.
Outputs
records array
Filtered records
JSON-safe records when output mode is RECORDS or AUTO resolves to RECORDS.
uri string
Stored Ion file URI
URI to the stored Ion file when output mode is STORE or AUTO resolves to STORE.
