Since 1999
Computer Science Graduate
Senior Data Engineer
Indie Developer
VIJAYA GOPINADHREDDY VELAGALA
Hyderabad, India [email protected]
Data Engineering Expertise
Architecting petabyte-scale Medallion Lakehouse ecosystems using PySpark, Databricks, and AWS/Azure serverless infrastructure.
Proven track record of sloshing compute latency and guaranteeing 100% data integrity via Write-Audit-Publish (WAP).
Technical Arsenal
Data Processing & Compute
PySpark
Apache Spark
Databricks / Delta Lake
dbt (Data Build Tool)
Flink2024
Cloud Ecosystem
AWS
Glue
Step Functions
Lambda
CloudFormationMay 2025
Aurora PostgreSQL
S3
Azure
Data Factory (ADF)Dec 2024
Synapse AnalyticsDec 2024
CosmosDBDec 2024
Event HubsDec 2024
Azure DevOps
GCP
Vertex AI
Gemini
Gen AI Leader
Firebase
AuthenticationFeb 2021
FirestoreFeb 2021
FunctionsFeb 2021
Architecture & Patterns
Data Architecture
Lakehouse / Medallion
Write-Audit-Publish (WAP)
Z-Ordering & Data Skipping
Distributed Systems
High/Low-Level System Design
Salted Joins
Software Design Patterns
MVC2024
Singleton2024
Observer2024
State Machine2024
DevOps, Testing & Infrastructure
Validation
Pytest
Automated Frameworks
CI/CD & Version Control
GitHub Actions
Git
Containerization
Docker
Foundational Programming & Full-Stack
Core Languages
Python
SQL
Generative AI
Prompt Engineering
JavaScript Ecosystem
ReactJSFeb 2021
NodeJSFeb 2021
Databases
MongoDBFeb 2021
MySQLFeb 2021
Web Fundamentals
PHPFeb 2021
HTML & CSSFeb 2021
Game Dev
C++2024
C#2024
Unity2024
Professional Experience
Active Missions
Feb 2025 – Present
ACTIVE
Infosys
CLIENT: British Petroleum
Specialist Programmer L2
- ❖Engineered an automated Pytest-driven validation framework within CI/CD pipelines, eliminating manual SQL checks and achieving a 0% defect injection rate for mission-critical reference data.
- ❖Architected serverless PySpark ETL pipelines utilizing AWS Glue and Step Functions, reliably processing multi-terabyte datasets while reducing execution time by 30%.
- ❖Standardized infrastructure deployments across Dev, Staging, and Prod environments using AWS CloudFormation, ensuring 100% environment parity across global regions.
Past Missions Archive
Jan 2018
Developers@Work
Freelance Software Engineer & Content Creator
MISSION STARTED
Click to decrypt logs...
May 2018
KK Consultancy
Full-Stack Developer Intern
MISSION STARTED
Click to decrypt logs...
Nov 2020
Infosys
Digital Specialist Engineer
MISSION STARTED
Click to decrypt logs...
Feb 2021
Infosys
Digital Specialist Engineer
MISSION ENDED
Click to decrypt logs...
Feb 2021
Developers@Work
Freelance Software Engineer & Content Creator
MISSION ENDED
Click to decrypt logs...
Feb 2021
KK Consultancy
Full-Stack Developer Intern
MISSION ENDED
Click to decrypt logs...
Mar 2021
Infosys
Specialist Programmer L1
MISSION STARTED
Click to decrypt logs...
Dec 2024
Infosys
Specialist Programmer L1
MISSION ENDED
Click to decrypt logs...
Technical Projects
Active Missions
Retail360 Enterprise Lakehouse
Databricks, Delta Lake, PySpark
- ›Designed a production-grade Medallion Lakehouse architecture (Bronze/Silver/Gold) for enterprise analytical workloads.
- ›Decreased analytical query latency by ~40% by implementing advanced Z-Ordering and Data Skipping techniques on Delta tables.
- ›Engineered Salted Join strategies in PySpark to efficiently mitigate data skew and prevent out-of-memory (OOM) errors in high-volume distributed joins.
- ›Guaranteed downstream data integrity by building a Write-Audit-Publish (WAP) pattern with rigorous data quality checks to prevent schema drift.
Past Missions Archive
May 2018
Maha Lakshmi Finance
PHP, MySQL, JavaScript, HTML, CSS
PROJECT STARTED
Click to decrypt logs...
Jun 2018
Red Ants (Social Community Platform)
PHP, MySQL, CSS, JavaScript
PROJECT STARTED
Click to decrypt logs...
Nov 2018
Maha Lakshmi Finance
PHP, MySQL, JavaScript, HTML, CSS
PROJECT DELIVERED
Click to decrypt logs...
Nov 2018
Red Ants (Social Community Platform)
PHP, MySQL, CSS, JavaScript
PROJECT DELIVERED
Click to decrypt logs...
Feb 2019
Anveshna (Event Management Portal)
PHP, MySQL, HTML, CSS, JavaScript
PROJECT STARTED
Click to decrypt logs...
May 2019
Sparkle Twilight (Auth Framework)
ReactJS, NodeJS, ExpressJS, Firebase
PROJECT STARTED
Click to decrypt logs...
Dec 2019
AAA (Academics Administration Automation)
Microservices Architecture, Node.js
PROJECT STARTED
Click to decrypt logs...
Feb 2020
Sparkle Twilight (Auth Framework)
ReactJS, NodeJS, ExpressJS, Firebase
PROJECT DELIVERED
Click to decrypt logs...
Apr 2020
Evolved Pattern Matching (Rabin-Karp)
Python
PROJECT STARTED
Click to decrypt logs...
Apr 2020
Movie Recommendation System
Python, Machine Learning (K-Means, Naive-Bayes), Flask
PROJECT STARTED
Click to decrypt logs...
May 2020
AAA (Academics Administration Automation)
Microservices Architecture, Node.js
PROJECT DELIVERED
Click to decrypt logs...
May 2023
Harmony Keeper 2D
C#, Unity, ShaderLab
PROJECT STARTED
Click to decrypt logs...
Jun 2023
Harmony Keeper 2D
C#, Unity, ShaderLab
PROJECT DELIVERED
Click to decrypt logs...
Aug 2023
Eggventure 3D (FPS Simulation)
C++, C#, Unity, ShaderLab, HLSL
PROJECT STARTED
Click to decrypt logs...
Sep 2023
Eggventure 3D (FPS Simulation)
C++, C#, Unity, ShaderLab, HLSL
PROJECT DELIVERED
Click to decrypt logs...
2024
Fruit Collector 3D
C#, Unity, Service Locator Pattern
PROJECT STARTED
Click to decrypt logs...
Education & Credentials
Degree
10th
Adity Jr. College, Tadepalligudem - Sasi Institute of Technology & Engineering - Jawaharlal Nehru Technological Universit, Kakinada(JNTUK) (Board of Intermediate Education, Andhra Pradesh) (Board of Secondary School of Education, Andhra Pradesh)
Timeline: JUN 2013 - APR 2014Duration: 1 YearCGPA: 6.9/10
Official Certifications
- Microsoft: Azure Data Engineer Associate (Expires: Jan 2026)
- Google Cloud: Generative AI Leader Certification (Expires: Sep 2028)
HackerRank Core Accreditations: SQL, Python, Java, Node, React, JavaScript, REST API- ✦Systems & Engineering: Infosys Certified Software Programmer
Professional Training
Full-Stack Game Development
- ›Platform: Outscal
- ›Focus: C++, Unity, MVC, Memory Management, Design Patterns.
- ›Duration: 6 Months
- ›Timeline: 2023 - Jan 2024
Courses & Development
MongoDB MongoDB Basics, MongoDB for Javascript Developers.
Data Engineering The Complete dbt Bootcamp (Udemy), Databricks Certified Data Engineer Prep (Udemy), Text Prompt Engineering & Real World AI Apps (Google)
Cloud & Architecture Ultimate AWS Certified Solutions Architect Associate SAA-C03 (Udemy), System Design (GeeksforGeeks).