A test suite to document the behavior of the Pyspark engine.

• Download Spark
• Run a test file: spark_path/bin/spark-submit sql/dataframe.py

Open the conf/log4j.properties file and change the logging level to ERROR: log4j.rootCategory=ERROR, console. Detailed instructions here.