Upskilling data engineers
A comprehensive guide to modern data engineering with local-first development practices
Pixi powering Telekom data cloud
At Magenta Telekom in Austria we build our new data platform around metadata and strong governance and an explicit graph of data dependencies. Pixi is a tool which enables …
Local data stack template
Jumpstart your data processing with this local modern data stack template
Cost efficient alternative to databricks lock-in
Spark-based data PaaS solutions are convenient. But they come with their own set of challenges such as a high vendor lock-in and obscured costs. We show how to use a dedicated …
Cloud arbitrage for spark pipelines
Spark-based data PaaS solutions are convenient. But they come with their own set of challenges such as a high vendor lock-in and obscured costs. We show how to use a dedicated …
Cost efficient alternative to databricks lock-in
Save money 💰 and increase developer productivity 👩💻👨💻 by limiting scope-creep of Spark-based data PaaS solutions: 🌐 turn them into an implementation detail 🔧.
Dagster, dbt, duckdb as new local MDS
Lean and efficient MDS experience: Delivers better software engineering practices to the data ecosystem with the new local MDS stack comprised of Dagster, dbt and DuckDB which …
Data Engineering in the DBT ecosystem
From the distributed monolith of CRON jobs to lazy coupling
Unlocking Advanced Metadata Extraction with the New DBT API in Dagster
📊 Unleash the power of metadata extraction in your data engineering pipelines with the new DBT API in Dagster! 🚀 Learn how to seamlessly integrate and leverage DBT transformations, …
Modern data stack in the enterprise
From the distributed monolith of CRON jobs to lazy coupling