Skip to main content

Large Language Model (LLM)

The Large Language Model (LLM) node is designed for data processing, analysis, and formatting. It enables you to interpret, generate, and transform data gathered by preceding action nodes (which collect information from external services) using Ava, our AI-powered virtual assistant. Instead of defining complex flow logic, you simply provide a direct question, such as Identify eks clusters that are using a version that will expire in less than 90 days from today and return the clusters arn. The LLM node can then make the resulting data available to other nodes in the flow for further actions.

Furthermore, you can reference specific fields from the previous nodes in the flow to ensure more accurate and consistent output. The LLM node can then output the generated data to a single field or JSON object, making it available for the next step in the flow, such as sending a notification.

LLM node example configuration

  • Prompt: Enter a question to ask Ava.

  • (Optional) Context: Add fields from previous nodes to provide more context to Ava.

  • Referencing the output:

    • Basic referencing: The AI-generated output is referenced from a single field.

    • Advanced referencing: The AI-generated output is referenced from multiple fields. Define the fields to be referenced in a JSON schema.