2

Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach
Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach

TLDR: Spark-based data PaaS solutions are convenient. But they come with their own set of challenges such as a high vendor lock-in and obscured costs. We show how to use a dedicated orchestrator (dagster-pipes). It can not only make Databricks an implementation detail but also save cost. Also, it improves developer productivity. It allows you to take back control.

Sep 2, 2024

The diaspora model for human migration
The diaspora model for human migration

May 20, 2024

Viral variant-resolved wastewater surveillance of SARS-CoV-2 at national scale
Viral variant-resolved wastewater surveillance of SARS-CoV-2 at national scale

Jul 16, 2022

Specialization in Criminal Careers
Specialization in Criminal Careers

Jul 16, 2022

Identifying the root cause of cable network problems with machine learning
Identifying the root cause of cable network problems with machine learning

Mar 14, 2022

Monitoring supply networks from mobile phone data for estimating the systemic risk of an economy
Monitoring supply networks from mobile phone data for estimating the systemic risk of an economy

Figure description: (a) Probability p(s∣c)p(s|c) to find a supply link, sij , given that there exists a communication link, cij, between firms i and j for communication links exceeding a given call duration, dij. Error bars denote the quartiles of a bootstrap simulation described in SI Text 1.

Oct 13, 2021

Preprint: Varieties of mobility measures: Comparing survey and mobile phone data during the COVID-19 pandemic
Preprint: Varieties of mobility measures: Comparing survey and mobile phone data during the COVID-19 pandemic

This publication is currently still a preprint under review.

Oct 1, 2021

Meteorological factors and non-pharmaceutical interventions explain local differences in the spread of SARS-CoV-2 in Austria
Meteorological factors and non-pharmaceutical interventions explain local differences in the spread of SARS-CoV-2 in Austria

Aug 21, 2021

Behavioral gender differences are reinforced during the COVID-19 crisis
Behavioral gender differences are reinforced during the COVID-19 crisis

Accepted by Nature Scientific Reports. Published now: 10.1038/s41598-021-97394-1

Oct 23, 2020

The impact of COVID-19 on relative changes in aggregated mobility using mobile-phone data
The impact of COVID-19 on relative changes in aggregated mobility using mobile-phone data

Management summary Mobility data from mobile phones are used to investigate mobility changes during Covid- 19 lock-down measures in Austria. Here we focus on relative changes between different sub-groups of the population by using the tools from compositional data analysis. This allows to gain much deeper insight into differences between the groups, and how these differences evolved over time.

Sep 4, 2020