Extract Tags

Extract Tags Processor #

Extracts structured tags from AI insights stored in document metadata using an LLM.

Configuration #

ParameterTypeRequiredDefaultDescription
message_fieldstringdocumentsThe field in the pipeline context containing the documents to process
output_queueobjectnullOptional queue configuration for sending processed documents to a output queue
model_providerstringYes-ID of the LLM provider
modelstringYes-Name of the LLM model
model_context_lengthuint32Yes-Minimum context length (min: 4000 tokens)

Example #

- extract_tags:
  model_provider: openai
  model: gpt-4o-mini
  model_context_length: 4000
Edit Edit this page