AI and data stack advisories

Severe, 6 weeks1496Projects326

1496 severe, 6 weeks · 326 projects

Apache SparkGHSA-fp5j-3fpf-mhj5

Sensitive data written to disk unencrypted in Spark

Apache Spark

CVE-2019-10099 · Published Aug 8, 2019 · updated Oct 24, 2024

High7.5
Fix: upgrade to 2.3.3 or later
GitHub advisory

Prior to Spark 2.3.3, in certain situations Spark would write user data to local disk unencrypted, even if spark.io.encryption.enabled=true. This includes cached blocks that are fetched to disk (controlled by spark.maxRemoteBlockSizeFetchToMem); in SparkR, using parallelize; in Pyspark, using broadcast and parallelize; and use of python udfs.

Affected versions

PackageAffectedFixed in
pyspark
PyPI
< 2.3.32.3.3
Details and references

More Apache Spark advisories

All Apache Spark