enrich_es

enrich_es #

CategoryScope
Enrichmentrecord

The “enrich_es” pipeline processor: join the current record against an Elasticsearch/Easysearch index and merge the matched document into the record (port of the gateway’s elasticsearch_lookup filter to the log pipeline).

Configuration #

FieldTypeDefaultDescription
elasticsearchstring“default”ID of the registered Elasticsearch/Easysearch cluster.
index_patternstringIndex name pattern to read from.
match_fieldstringField the pattern match runs against.
es_fieldstring""Elasticsearch-side field involved in the enrichment join.
targetstring“enriched”Destination prefix or field to write the result to.
cache_ttlstringTTL of the enrichment lookup cache.
ignore_missingbooltrueDo not fail when the source field is missing.
ignore_failureboolDo not fail the record when processing errors; the record passes through unchanged.
tagstringTag appended to the record when processing fails.

Example #

processor:
  - enrich_es:
      elasticsearch: "default"
      index_pattern: "index_pattern"
      match_field: "match_field"
      es_field: "es_field"
      target: "parsed"
Edit Edit this page