Collector settings

The collector settings are used by the collector to successfully parse CSV files.

Collector settings

Basic settings

IncomingDirectoryPath

Description: Directory to monitor for files matching FileMask. Paths are absolute

Required: yes

Example: c:\plantdata\incoming

ProcessedDirectoryPath

Description: Directory to which successfully processed files are moved. Paths are absolute

Required: yes

Example: c:\plantdata\processed

Processed files are files which had at least one measurement sent to Influx.

Note: when a CSV measurement name is not found in the measurements configuration, the file will still be marked as processed successfully.

ErrorDirectoryPath

Description: Directory in which files that contained an error will be put. Invalid CSV files will be stored here

Required: yes

Example: c:\plantdata\failed

No points will have been processed for this file.

FileMask

Description: File mask of the files to use

Required: yes

Default value: *.csv

The file mask for which the collector will monitor.

NameInCSVColumn

Description: Index of column holding the measurement name in the csv (starts from 0

Required: yes

Default value: 0

TimestampColumn

Description: Index of column holding the timestamp (starts from 0)

Required: yes

Default value: 1

ValueColumn

Description: Index of column holding the value (starts from 0)

Required: yes

Default value: 7

StatusColumn

Description: Index of column holding the status (starts from 0)

Required: yes

Default value: 6

Delimiter

Description: The delimiter"

Required: yes

Default value: ,

TimestampLayout

Description: The layout of the timestamp of the measurements, default RFC3339 will be used. More info: https://pkg.go.dev/time#Layout

Required: no

Default value: ,

Advanced settings

Advanced settings

ProcessInterval

Description: Delay in milliseconds for processing new files after the were detected

Required: no

Default value: 10000

ProcessDelay

Description: Delay in milliseconds for processing new files after the were detected

Required: no

Default value: 3000

StartupDelay

Description: Initial delay for checking the incoming directory in milliseconds

Required: no

Default value: 9000

ProcessedMaxAge

Description: The maximum time in minutes to keep processed files. 0 will keep the files indefinitely

Required: no

Default value: 43200

FailedMaxAge

Description: The maximum time in minutes to keep failed files. 0 will keep the files indefinitely

Required: no

Default value: 129600

CSVBatchSize

Description: If set, the collector will send points to the buffer in batches while reading the csv file

Required: no

Default value: 129600