big-data

Parallel aggregation of dataframes
Use idempotency of RDD’s to your advantage
Georg Heiler
Last updated on Oct 29, 2020 1 min read
Geospatial binning with hexagons on spark
Bring hexagons as efficient spatial operations to spark
Georg Heiler
Last updated on Nov 28, 2019 2 min read
Geospatial binning with hexagons on spark
data processing
recent history of data processing.
Aug 4, 2019 9:00 AM — 11:00 AM Yogyakarta, Indonesia
Georg Heiler
Follow
data processing
Spark descriptive name for cached dataframes
Display user friendly names for cached table in Spark web UI
Georg Heiler
Last updated on Nov 20, 2019 1 min read
Solve data skew issues for array columns in spark
Preventing data skew issues for Arrays.
Georg Heiler
Last updated on Nov 20, 2019 4 min read
Ultimate open vector geoprocessing on spark
Combine the strengths from geomesa and geospark for ultimate geoprocessing capabilities on spark
Georg Heiler
Last updated on Oct 29, 2020 4 min read
Ultimate open vector geoprocessing on spark
Analyze OSM data in spark
Analyze the OSM community and extract geometries from the graph.
Georg Heiler
Last updated on Oct 29, 2020 2 min read
OSM to Spark
Processing OSM in a scalable hadoop native way.
Georg Heiler
Last updated on Oct 29, 2020 6 min read
OSM to Spark
Headless spark on YARN
Sometimes you want to run a different version of spark than the one offered by your distributor. This is easily possible.
Georg Heiler
Last updated on Nov 20, 2019 2 min read
Headless spark on YARN
Dynamically select columns by type
Dynamically select columns by type in spark
Georg Heiler
Last updated on Nov 20, 2019 1 min read