You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Production-style Netflix data lakehouse platform built on AWS, implementing a Medallion (Bronze–Silver–Gold) architecture to transform raw data into analytics-ready datasets. The pipeline leverages AWS Glue for scalable ETL processing, S3 as a data lake storage layer, Athena for serverless SQL analytics & Automated Glue workflows for Orchestration.
Automated serverless ETL pipeline built on Aws.In this project transformation of CSV data ingested into S3 is done ,using Aws Lamda to trigger Aws Glue Workflow containing Crawlers and Spark ETL jobs.The processed data is then Loaded into Redshift,with real time notification via Amazon SNS through EventBridge.