csv

csv #

CategoryScope
Parsingrecord

The “csv” pipeline processor: parse a CSV line into named fields (Vector’s parse_csv equivalent). Headers come from configuration; missing columns get auto names col_N.

Configuration #

FieldTypeDefaultDescription
fieldstringSource field to read from.
headersliststringExtra headers sent with each request.
delimiterstring“,”Field delimiter.
target_fieldstringDestination field to write the result to.
ignore_missingboolDo not fail when the source field is missing.
ignore_failureboolDo not fail the record when processing errors; the record passes through unchanged.
tagstringTag appended to the record when processing fails.

Example #

processor:
  - csv:
      field: "message"
      headers: []
      delimiter: "delimiter"
      target_field: "parsed"
      ignore_missing: true
Edit Edit this page