PySpark and Spark Compute Clusters

Use PySpark with PlaidCloud — connect to project tables, read data into Spark DataFrames, and run distributed transformations alongside the rest of your data pipeline.