Posts

Deterministic scale-out for spark jobs under increased load
Make spark jobs scale reliably using iteration
Georg Heiler
Oct 29, 2020 2 min read
Spark and Hive 3
Get spark and Hive to play nice again on HDP 3.1
Georg Heiler
Oct 29, 2020 2 min read
Parallel aggregation of dataframes
Use idempotency of RDD’s to your advantage
Georg Heiler
Last updated on Oct 29, 2020 1 min read
Tricks for scala with gradle
Get compiler heavy scala projects to build using gradle
Georg Heiler
Nov 29, 2019 1 min read
reproducible geospatial visualization in kepler.gl
Reproducible, effortless & great looking visualization of geospatial data.
Georg Heiler
Last updated on Nov 28, 2019 5 min read
reproducible geospatial visualization in kepler.gl
Geospatial binning with hexagons on spark
Bring hexagons as efficient spatial operations to spark
Georg Heiler
Last updated on Nov 28, 2019 2 min read
Geospatial binning with hexagons on spark
Spark descriptive name for cached dataframes
Display user friendly names for cached table in Spark web UI
Georg Heiler
Nov 20, 2019 1 min read
Data links KW 28
Useful links
Georg Heiler
Nov 20, 2019 1 min read
Writing technical content in Markdown
Wowchemy is designed to give technical content creators a seamless experience. You can focus on the content and Wowchemy handles the rest. Highlight your code snippets, take notes on math classes, and draw diagrams from textual representation.
Last updated on Oct 2, 2022 6 min read
Writing technical content in Markdown
Solve data skew issues for array columns in spark
Preventing data skew issues for Arrays.
Georg Heiler
Nov 20, 2019 4 min read