Dagster, dbt, duckdb as new local MDS
Lean and efficient MDS experience: Delivers better software engineering practices to the data ecosystem with the new local MDS stack comprised of Dagster, dbt and DuckDB which offers better developer productivity by enhancing testability of the E2E pipeline.
Dec 11, 2023
Data Engineering in the DBT ecosystem
Resolving the pain of the distributed data monolith with governance and orchestration. Code examples of a similar previous talk: https://github.com/geoHeil/dataengineering-meetup-vienna-2023-05 Date: 2023-09-06
Sep 6, 2023
Unlocking Advanced Metadata Extraction with the New DBT API in Dagster
📊 Unleash the power of metadata extraction in your data engineering pipelines with the new DBT API in Dagster! 🚀 Learn how to seamlessly integrate and leverage DBT transformations, while enriching your data catalog with advanced metadata. Elevate your data governance and collaboration to new heights!
Jun 13, 2023
Modern data stack in the enterprise
Resolving the pain of the distributed data monolith with governance and orchestration. Code examples: https://github.com/geoHeil/dataengineering-meetup-vienna-2023-05 Date: 2023-05-10
May 10, 2023
Comparing SQL-based streaming approaches
Comparing established and up-and-coming streaming approaches for an integrated real-time data model
Apr 1, 2022
Connector goodness from Airbyte E2E lineage
Simplify data ingestion with the plentiful connectors of Airbyte without compromising on data lineage
Mar 4, 2022
Tame your notebooks
Include jupyter notebooks into reliable data pipelines.
Mar 4, 2022
Fully-fledged example with resources
A full example E2E
Mar 4, 2022
Turning the data pipeline inside out
Flip the data pipeline to get a better notion about the things we actually care about: data assets not transformations.
Mar 4, 2022
Modern data orchestration using Dagster
Overview over the modern data stack ecosystem. Introduction to this blog series
Mar 4, 2022