Pyspark

This repositry contains all codes related to Pyspark.

1. The very basic codes of Pyspark - "Pyspark level1 - Basics(1).ipynb"

2. A short excercise by practising few basic codes - "Pyspark Excercise1.ipynb"

3. Introduction to MLlib and Linear regression - "Linear Regression - MLlib.ipynb"

4. Logistic Regression using MLlib - "Logistic_regression_Notebook.ipynb"

5. DTC,RFC,GradientB using MLlib - "Decision Trees & Random Forests.ipynb"

6. Kmeans Clustering using MLlib - "Kmeans Clustering.ipynb"

7. NLP using MLlib - "NLP.ipynb"

8. Applying functions on Pandas/Spark dataframe - "Pandas_Spark_UDF.ipynb"

9. Delta table - Loading data from delta table - Saving back to delta table - Time Travel - Delta Table.ipynb