Posts

Turning the data pipeline inside out
Flip the data pipeline to get a better notion about the things we actually care about: data assets not transformations.
Georg Heiler, Sandy Ryza
Last updated on Mar 17, 2022 7 min read
Turning the data pipeline inside out
From hello-world to simple pipelines
Getting started with simple dagster pipelines.
Georg Heiler, Sandy Ryza
Last updated on Mar 17, 2022 6 min read
From hello-world to simple pipelines
Modern data orchestration using Dagster
Overview over the modern data stack ecosystem. Introduction to this blog series
Georg Heiler, Sandy Ryza
Last updated on Apr 22, 2022 5 min read
Modern data orchestration using Dagster
Interactive dagster debugging
Interacting with a running dagster instance interactively
Georg Heiler
Last updated on Feb 11, 2022 3 min read
Interactive dagster debugging
Scalable sparse matrix multiplication
Using Apache Spark for sparse matrix multiplication
Georg Heiler
Last updated on Aug 9, 2021 6 min read
Scalable sparse matrix multiplication
COVID population model
WWTF COVID project summary
Georg Heiler
Last updated on May 13, 2021 1 min read
COVID population model
ML project configuration management
Easy configuration handling for complex machine learning pipelines
Georg Heiler
Last updated on May 9, 2021 1 min read
Can you tell the nuts & berries apart in each group?
Guaranteed anonymity in high-dimensional data using differential privacy
Georg Heiler
Last updated on Aug 6, 2021 14 min read
Can you tell the nuts & berries apart in each group?
Intersting links about deep learning
Useful links
Georg Heiler
Last updated on May 9, 2021 1 min read
Exact percentiles in Spark
Combining the power of Scala and Python to make the calculation of percentiles in Spark easy and fast
Georg Heiler
Last updated on Nov 22, 2020 7 min read