Georg Heiler
Georg Heiler
Home
Blog
Publications
Projects
Lecturing
Talks
Contact
Light
Dark
Automatic
dagster
Data Engineering in the DBT ecosystem
From the distributed monolith of CRON jobs to lazy coupling
Sep 6, 2023 12:00 AM
Budapest, virtual Zoom
Georg Heiler
Slides
Unlocking Advanced Metadata Extraction with the New DBT API in Dagster
📊 Unleash the power of metadata extraction in your data engineering pipelines with the new DBT API in Dagster! 🚀 Learn how to seamlessly integrate and leverage DBT transformations, while enriching your data catalog with advanced metadata. Elevate your data governance and collaboration to new heights!
Georg Heiler
Last updated on Aug 7, 2023
4 min read
Modern data stack in the enterprise
From the distributed monolith of CRON jobs to lazy coupling
May 10, 2023 12:00 AM
Vienna, Austria
Georg Heiler
Slides
Governance and pipelines in the modern data stack
The data orchestrator is at the heart of the data pipelines. We start by exploring how a modern data orchestrator drastically eases the development of pipelines. Then we will see how govanance can be conducted efficiently in a MDS-based setup.
Dec 8, 2022 4:00 PM — 8:00 PM
weXelerate
Georg Heiler
Orchestrating data in the mesh of the fragmented modern data stack
The fragmented modern data stack has emerged as the unbundling of Airflow. Various tools operate in silos. Dagster as a next-generation data orchestrator allows you to clearly see the data dependencies of the individual pipelines on your data factory floor.
Apr 27, 2022 12:18 AM — 12:20 AM
Georg Heiler
Slides
Video
Comparing SQL-based streaming approaches
Comparing established and up-and-coming streaming approaches for an integrated real-time data model
Georg Heiler
Last updated on Apr 25, 2022
26 min read
SFTP sensor
Way too many data pipelines still work with SFTP file transfer. Even a modern data orchestrator needs to interface here well.
Georg Heiler
,
Sandy Ryza
Last updated on Apr 30, 2022
5 min read
Connector goodness from Airbyte E2E lineage
Simplify data ingestion with the plentiful connectors of Airbyte without compromising on data lineage
Georg Heiler
,
Sandy Ryza
Last updated on Mar 17, 2022
3 min read
Scalable data pipelines from dagster with pyspark
Getting started with simple dagster pipelines.
Georg Heiler
,
Sandy Ryza
Last updated on Mar 17, 2022
5 min read
Tame your notebooks
Include jupyter notebooks into reliable data pipelines.
Georg Heiler
,
Sandy Ryza
Last updated on Mar 17, 2022
4 min read
»
Cite
×