ETL migration to an open SQL ETL: {oa-tbx}

Once ETL processes have been converted to SQL by {openAudit}, they can be run inside the {oa-tbx} container, which provides a serverless execution environment for SQL, Python, or Java processes, driven by configuration repositories and an orchestrator.

{oa-tbx} was born from ETL-to-SQL migrations: DataStage, Talend, BODS, Informatica, and SSIS in particular. The goal isn’t simply to migrate away from a proprietary ETL. We transform the processes into standard SQL so they can run in a modern, open environment that can be industrialized with Airflow.

{oa-tbx} handles extraction and loading (the E and the L of ETL). The transformation (the T) stays lock-in free, with dbt models if desired: dbt and {oa-tbx} are complementary. It is optimized by {oa-tbx}’s embedded columnar / in-memory SQL engine, serverless.

To go further