Skip to main content

stage

Synopsis

starlake stage [options]

Description

Move the files from the landing area to the pending area.

Files are loaded one domain at a time.

Each domain has its own directory and is specified in the "directory" key of Domain YML file compressed files are uncompressed if a corresponding ack file exist.

Compressed files are recognized by their extension which should be one of .tgz, .zip, .gz. raw file should also have a corresponding ack file before moving the files to the pending area, the ack files are deleted.

To import files without ack specify an empty "ack" key (aka ack:"") in the domain YML file.

"ack" is the default ack extension searched for but you may specify a different one in the domain YML file.

comet import

Parameters

ParameterCardinalityDescription
--domains:domain1,domain2...OptionalDomains to stage
--options:k1=v1,k2=v2...Optional, UnboundedStage arguments to be used as substitutions