OpenLineage column-lineage facet — sql_openlineage • polyglotSQL

Produces an OpenLineage-compatible columnLineage facet plus inferred input/output datasets for a SQL statement, for integration with data catalogs and lineage backends.

Usage

sql_openlineage(
  sql,
  dialect = "generic",
  schema = NULL,
  namespace = NULL,
  job_name = NULL
)

Arguments

sql: A single character string with one or more SQL statements (separated by ;).
dialect: Dialect used for parsing.
schema: Optional schema specification (see as_polyglot_schema()); improves resolution of unqualified or ambiguous columns.
namespace: Optional dataset namespace applied to inferred datasets.
job_name: Optional job name recorded in the facet.

Value

A list with elements facet (the OpenLineage columnLineage facet), inputs, outputs (dataset descriptors) and warnings.

Examples

ol <- sql_openlineage(
  "INSERT INTO reports SELECT id, total FROM sales",
  namespace = "warehouse"
)
names(ol)
#> [1] "facet"    "inputs"   "outputs"  "warnings"