Georg Heiler
Georg Heiler
Home
Blog
Publications
Projects
Lecturing
Talks
Contact
Light
Dark
Automatic
apache-spark
Scalable sparse matrix multiplication
Using Apache Spark for
sparse
matrix multiplication
Georg Heiler
Last updated on Aug 9, 2021
6 min read
Exact percentiles in Spark
Combining the power of Scala and Python to make the calculation of percentiles in Spark easy and fast
Georg Heiler
Last updated on Nov 22, 2020
7 min read
Arrow 2.0.0 - structs in pandas
Finally, nested types in Arrow.
Georg Heiler
Last updated on Nov 20, 2020
1 min read
Sparkling SCD2
Data preparation using spark without ACID tables
Georg Heiler
Last updated on Nov 19, 2020
4 min read
Run the latest version of spark
Execute the latest version of spark on HDP.
Georg Heiler
Last updated on Oct 29, 2020
4 min read
Production grade pyspark jobs
Use additional python packages with pyspark
Georg Heiler
Last updated on Nov 19, 2020
2 min read
Deterministic scale-out for spark jobs under increased load
Make spark jobs scale reliably using iteration
Georg Heiler
Last updated on Oct 29, 2020
2 min read
Spark and Hive 3
Get spark and Hive to play nice again on HDP 3.1
Georg Heiler
Last updated on Oct 29, 2020
2 min read
Parallel aggregation of dataframes
Use idempotency of RDD’s to your advantage
Georg Heiler
Last updated on Oct 29, 2020
1 min read
Geospatial binning with hexagons on spark
Bring hexagons as efficient spatial operations to spark
Georg Heiler
Last updated on Nov 28, 2019
2 min read
»
Cite
×
