pyspark

Exact percentiles in Spark

Combining the power of Scala and Python to make the calculation of percentiles in Spark easy and fast

Arrow 2.0.0 - structs in pandas

Finally, nested types in Arrow.

Production grade pyspark jobs

Use additional python packages with pyspark