AI Ollama

AI Ollama
Certified
Use local Ollama models

Calls an Ollama server for chat/embeddings using the given endpoint and model name. Ideal for self-hosted/local models; ensure the Ollama daemon is reachable.

yaml
type: io.kestra.plugin.ai.provider.Ollama

Examples

Chat completion with Ollama

yaml
id: chat_completion
namespace: company.ai

inputs:
  - id: prompt
    type: STRING

tasks:
  - id: chat_completion
    type: io.kestra.plugin.ai.completion.ChatCompletion
    provider:
      type: io.kestra.plugin.ai.provider.Ollama
      modelName: llama3
      endpoint: http://localhost:11434
    configuration:
      thinkingEnabled: true
      returnThinking: true
    messages:
      - type: SYSTEM
        content: You are a helpful assistant, answer concisely, avoid overly casual language or unnecessary verbosity.
      - type: USER
        content: "{{ inputs.prompt }}"

Properties

endpoint *string

Model endpoint

modelName *string

Model name

baseUrl string

Base URL

Custom base URL to override the default endpoint (useful for local tests, WireMock, or enterprise gateways).

caPem string

CA PEM certificate content

CA certificate as text, used to verify SSL/TLS connections when using custom endpoints.

clientPem string

Client PEM certificate content

PEM client certificate as text, used to authenticate the connection to enterprise AI endpoints.

Pinecone

Interact with Pinecone, a managed vector database, from your Kestra workflows. Create serverless indexes, upsert vectors, query by similarity, fetch or delete vectors by ID, and inspect index statistics.

AIData

Klaviyo

Tasks that interact with Klaviyo campaign APIs.

AIBusiness

AI OllamaCertifiedUse local Ollama models

More Plugins in this Category

Pinecone

Klaviyo

AI Ollama
Certified
Use local Ollama models