Enterprise ETL Pipeline Optimization
Architected medallion architecture data pipelines processing 50+ tables with Python/PySpark. Implemented schema mappings, filters, and join conditions for Parquet/Delta formats.
Mridul Gupta
Data Engineer & ML Specialist
Transforming raw data into actionable insights through scalable ETL pipelines and advanced analytics solutions
📍 Bengaluru, Karnataka
Technical Expertise & Background
Data Engineer with 1+ years of experience at Tredence Inc., specializing in Azure cloud ecosystem and large-scale ETL pipeline optimization. Successfully modified 50+ table schemas and achieved 60% runtime reduction in critical data workflows. Former Data Science Intern with expertise in CNN-based audio processing and computer vision solutions. Certified Databricks Data Engineer Associate with proven track record in medallion architecture implementation.
Cloud Platforms
- Azure Data Factory
- Azure Synapse Analytics
- Databricks
- Azure DevOps
- Azure Data Lake Storage
Programming
- Python
- SQL
- C++
- PySpark
Data Technologies
- Apache Spark
- Delta Lake
- Unity Catalog
- ETL Frameworks
ML Libraries
- TensorFlow
- PyTorch
- scikit-learn
- OpenCV
- Pandas
- NumPy
Development Tools
- GitHub
- Git
- VS Code
- PyCharm
Certifications
Databricks Certified Data Engineer Associate (Sept 2024)
Advanced Certification in Data Science and NLP (IIIT Bangalore, 2024)
Fundamentals of Deep Learning (upGrad, Mar 2024)
Professional Journey
Tredence Inc.
Data Engineer
Oct 2024 – Present | Bengaluru
- Led UPC project modifications across 50+ tables with Python/PySpark ETL pipelines
- Performed impact assessment on 100+ database objects
- Optimized Databricks workflows achieving 60% runtime reduction
- Validated outputs through comprehensive testing and documentation
- Integrated JSON, CSV, SQL data sources using ADF and Unity Catalog
Zummit Infolabs
Data Scientist Intern
Mar 2023 – Jan 2024
- Designed custom audio dataset for deaf speech recognition with CNN classifier
- Achieved successful digit classification in phase one implementation
- Developed red-eye detection system with 95% detection accuracy
- Implemented 85% correction accuracy using computer vision techniques
MTech Integrated in Information Technology
Devi Ahilya Vishwavidyalaya
July 2017 – June 2022
July 2017 – June 2022
CGPA: 8.5
Featured Projects & Research
Deaf Person Audio-to-Text Classification
Developed CNN-based speech classifier with custom audio dataset. Extracted MFCC, delta, CQT spectrogram features for temporal sequence analysis. Achieved successful digit classification as foundation for multimodal system.
Automated Red-Eye Detection System
95% detection accuracy computer vision solution using CNN classifier and 68-point facial landmark localization. Outperformed existing solutions in asymmetric flash scenarios.
IceCube Neutrino Detection Analysis
Processed compressed parquet datasets for neutrino detection insights. Created multi-dimensional 3D Earth visualization for particle location mapping.
Let's Build Something Amazing Together
Ready to tackle your next data challenge? I'm available for full-time opportunities, consulting projects, and technical collaborations.