Data lineage in databases
A real data lineage in underlying layers, exhaustive and totally automated, which presents multiple views according to needs.
Resolving data lineage breaks
> Views: if they are stored, {openAudit} will read them, even if they are stacked (views of views of views...).
> Dynamic SQL: If {openAudit} fails to resolve it directly, the dynamic SQL is resolved with runtime parameters, or with runtime logs.
> Other: in the event of transfer of information by FTP, or when the database schema is not specified (this is the case in many ELT/ETLs), {openAudit} resolves these breaks by structural recognition , where
{openAudit} reads the Batch / Shell.
Dynamicly combine different data transformation technologies
> {openAudit} analyzes all processing technologies (object language/procedural, ELT/ETL), on-premise or Cloud, and combines them in a single data flow, at the level the
finer. The drill through provides access to the code.
> The process is dynamic, operated in delta mode, daily, and therefore synchronized with the information system.
Different levels of analysis
> Cloud of points: this view allows to instantly know the uses of a data point by disregarding transformations. It is also possible from a use (a dashboard, data from a dashboard, a query), to instantly
identify its operational sources.
> Mapping: this view allows from any data point (field, table) to display a complete mapping of the upstream or downstream flow, i.e. from the operational sources to the exposure of the data (dataviz,
query...). The information used is highlighted, and the uses of the information are specified on the flyover (who consults the data, when, how).
> Granular data lineage: this view makes it possible to gradually follow the deployment of data in the information system from a data point by iterative clicks, or conversely to go back to operational
sources. Each transformation (ELT/ETL job, procedural code/object) can be analyzed with the “drill through”. The precise details of the uses of the data (who consults it, when, how, etc.) are specified.