AI Milvus

AI Milvus
Certified
Store embeddings in Milvus

Connects via URI or host/port with token-based auth; creates the target collection if missing. Metric/index/consistency options map to Milvus settings; drop=true clears the collection. Use defaults for host=localhost, port=19530, secure gRPC unless overridden.

yaml
type: io.kestra.plugin.ai.embeddings.Milvus

Examples

Ingest documents into a Milvus embedding store

yaml
id: document_ingestion
namespace: company.ai

tasks:
  - id: ingest
    type: io.kestra.plugin.ai.rag.IngestDocument
    provider:
      type: io.kestra.plugin.ai.provider.GoogleGemini
      modelName: gemini-embedding-001
      apiKey: "{{ secret('GEMINI_API_KEY') }}"
    embeddings:
      type: io.kestra.plugin.ai.embeddings.Milvus
      # Use either `uri` or `host`/`port`:
      # For gRPC (typical): milvus://localhost:19530
      # For HTTP: http://localhost:9091
      uri: "http://localhost:9091"
      token: "{{ secret('MILVUS_TOKEN') }}"
      collectionName: embeddings
    fromExternalURLs:
      - https://raw.githubusercontent.com/kestra-io/docs/refs/heads/main/content/blogs/release-0-24.md

Properties

token *string

Token

Milvus auth token. Required.

autoFlushOnDelete booleanstring

Auto flush on delete

If true, flush after delete operations.

autoFlushOnInsert booleanstring

Auto flush on insert

If true, flush after insert operations. Setting it to false can improve throughput.

collectionName string

Collection name

Target collection. Created automatically if it does not exist. Default: "default".

consistencyLevel string

Consistency level

Read/write consistency level. Common values include STRONG, BOUNDED, or EVENTUALLY (depends on client/version).

databaseName string

Database name

Logical database to use. If not provided, the default database is used.

host string

Host

Milvus host name (used when uri is not set). Default: "localhost".

idFieldName string

ID field name

Field name for document IDs. Default depends on collection schema.

indexType string

Index type

Vector index type (e.g., IVF_FLAT, IVF_SQ8, HNSW). Depends on Milvus deployment and dataset.

metadataFieldName string

Metadata field name

Field name for metadata. Default depends on collection schema.

metricType string

Metric type

Similarity metric (e.g., L2, IP, COSINE). Should match the embedding provider’s expected metric.

password string

Password

Required when authentication/TLS is enabled. See https://milvus.io/docs/authenticate.md

port integerstring

Port

Milvus port (used when uri is not set). Typical: 19530 (gRPC) or 9091 (HTTP). Default: 19530.

retrieveEmbeddingsOnSearch booleanstring

Retrieve embeddings on search

If true, return stored embeddings along with matches. Default: false.

textFieldName string

Text field name

Field name for original text. Default depends on collection schema.

uri string

URI

Connection URI. Use either uri OR host/port (not both). Examples:

gRPC (typical): "milvus://host: 19530"
HTTP: "http://host: 9091"

username string

Username

Required when authentication/TLS is enabled. See https://milvus.io/docs/authenticate.md

vectorFieldName string

Vector field name

Field name for the embedding vector. Must match the index definition and embedding dimensionality.

Pinecone

Interact with Pinecone, a managed vector database, from your Kestra workflows. Create serverless indexes, upsert vectors, query by similarity, fetch or delete vectors by ID, and inspect index statistics.

AIData

Klaviyo

Tasks that interact with Klaviyo campaign APIs.

AIBusiness

AI MilvusCertifiedStore embeddings in Milvus

More Plugins in this Category

Pinecone

Klaviyo

AI Milvus
Certified
Store embeddings in Milvus