unarchive

Available in: Cloud, Self-Managed

Unarchives messages according to the selected archive format into multiple messages within a batch.

# Config fields, showing default values
label: ""
unarchive:
  format: "" # No default (required)

When a message is unarchived the new messages replace the original message in the batch. Messages that are selected but fail to unarchive (invalid format) will remain unchanged in the message batch but will be flagged as having failed, allowing you to error handle them.

Metadata

The metadata found on the messages handled by this processor will be copied into the resulting messages. For the unarchive formats that contain file information (tar, zip), a metadata field is also added to each message called archive_filename with the extracted filename.

Fields

format

The unarchiving format to apply.

Type: string

Option Summary

binary

Extract messages from a binary blob format.

csv

Attempt to parse the message as a csv file (header required) and for each row in the file expands its contents into a json object in a new message.

csv:x

Attempt to parse the message as a csv file (header required) and for each row in the file expands its contents into a json object in a new message using a custom delimiter. The custom delimiter must be a single character, e.g. the format "csv:\t" would consume a tab delimited file.

json_array

Attempt to parse a message as a JSON array, and extract each element into its own message.

json_documents

Attempt to parse a message as a stream of concatenated JSON documents. Each parsed document is expanded into a new message.

json_map

Attempt to parse the message as a JSON map and for each element of the map expands its contents into a new message. A metadata field is added to each message called archive_key with the relevant key from the top-level map.

lines

Extract the lines of a message each into their own message.

tar

Extract messages from a unix standard tape archive.

zip

Extract messages from a zip file.