Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app
Work Background
Tiger AnalyticsSenior Data Engineer
Dec. 2022London Area, United Kingdom• Spearheaded the implementation of end-to-end data pipelines using Azure Data Factory, Databricks, and ADLS, integrating diverse data sources and ensuring seamless data flow, resulting in increased data accuracy and timely insights for strategic business decisions.
• Designed and maintained a medallion architecture (Bronze, Silver, and Gold) to enhance data processing quality, delivering high-standard data for business reporting.
• Developed robust data processing systems using PySpark, optimizing large-scale datasets and enabling real-time retail insights.
• Optimized SparkSQL and PySpark scripts in data transformation processes, improving pipeline efficiency by 30% and enabling real-time data analytics for business insights.
• Developed scalable data models using Kimball dimensional modeling techniques, optimizing query performance and enhancing data accessibility for reporting.
• Implemented Azure Purview for data lineage tracking, data cataloging, and regulatory compliance, ensuring adherence to GDPR and enhancing data quality standards.
•Enhanced infrastructure by implementing Infrastructure as Code (IaC) using Terraform, automating cloud provisioning with CI/CD pipelines, leading to faster and more reliable deployments.
•Collaborated with cross-functional teams to deliver innovative data solutions, aligning with business goals and driving impactful results.
Tiger AnalyticsData Engineer
Sep. 2021 - Dec. 2022London Area, United Kingdom
InfosysData Engineer
Aug. 2017 - Sep. 2019Hyderabad, Telangana, India
Intch is a Professional Networking App for the Future of WorkSee more people like Manoj on Intch
300k+ people
130+ countries
AI matching
Get Intch if you'd like to
489368 people
16
Senior software engineer
19
Project manager @ Zois Energy limited
20
Project and business Manager
38549 people
19
Project manager @ Zois Energy limited
18
Financial Consultant @ Standard capital corporation
121
Investor Relations Manager @ ExxonMobil