Extract | Declarative Data Pipelines

📄️ Tutorial

Extract tables in one shot or incrementally from a database as a set of files.

Query extraction is useful when you want to extract schema's and data based on a user-defined query.

Incremental extraction is useful when you want to extract only the data that has changed since the last extraction.

To make extraction faster, we can parallelize the extraction process.

Starlake keeps track of the successive extractions in the table SLLASTEXPORT located in the audit schema (audit by default).

For some databases, when extracting table schemas, we need to specify the location of the table and column comments f