Scala
fromMedium
2 days agoSnowpark Scala 2.13 Public Preview
Scala 2.13 is available in Public Preview on Snowpark for Scala client, UDxF and Stored Procedures, bringing collection, performance, and language improvements to Snowflake.
The spark-sql-perf toolkit doesn't work for Spark 4.0+ currently, and this guide shows you how to get it running(with a custom patch). While many developers have their own complex Spark setup, this workflow is designed to be simple and reproducible. It only requires an AWS account to provision a cluster and run a full benchmark from scratch. We'll focus on the patch, the build process, and how a tool like FlintRock makes deploying custom Spark clusters incredibly simple.