Data Engineering Problems with Solution

Here, we are solving all the Data Engineering problems using below methods

1. Solving problem using PySpark
   1. Using PySpark Functions
   2. Using Spark SQL
2. Solving problem using SQL (PostgreSQL or MySQL)

Please find list of all the problems

0. Problem0 -> Get Employee with salary more than 100K
1. Problem1 -> Get Max Salary for each Employee
2. Problem2 -> Get Salary of all employees in Marketing department
3. Problem3 -> Find diff between count of cities and distict count of cities
4. Problem4 -> Get Shortest and Longest City Name
5. Problem5 -> CITY names starting with vowels
6. Problem6 -> Students more than 75 Marks
7. Problem7 -> Returning active users
8. Problem8 -> Top distance travelled
9. Problems 9 -> Premium vs Freemium

Also find below blog for understanding all the data engineering problems

https://developershome.blog/category/data-engineering/problem-solving/

Also find below youtube channel for understanding all the data engineering problems and learning new concepts of data engineering.

https://www.youtube.com/@developershomeIn