Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app
Work Background
Senior Data Engineer
Tiger AnalyticsSenior Data Engineer
Dec. 2022London Area, United Kingdom• Spearheaded the implementation of end-to-end data pipelines using Azure Data Factory, Databricks, and ADLS, integrating diverse data sources and ensuring seamless data flow, resulting in increased data accuracy and timely insights for strategic business decisions. • Designed and maintained a medallion architecture (Bronze, Silver, and Gold) to enhance data processing quality, delivering high-standard data for business reporting. • Developed robust data processing systems using PySpark, optimizing large-scale datasets and enabling real-time retail insights. • Optimized SparkSQL and PySpark scripts in data transformation processes, improving pipeline efficiency by 30% and enabling real-time data analytics for business insights. • Developed scalable data models using Kimball dimensional modeling techniques, optimizing query performance and enhancing data accessibility for reporting. • Implemented Azure Purview for data lineage tracking, data cataloging, and regulatory compliance, ensuring adherence to GDPR and enhancing data quality standards. •Enhanced infrastructure by implementing Infrastructure as Code (IaC) using Terraform, automating cloud provisioning with CI/CD pipelines, leading to faster and more reliable deployments. •Collaborated with cross-functional teams to deliver innovative data solutions, aligning with business goals and driving impactful results.
Data Engineer
Tiger AnalyticsData Engineer
Sep. 2021 - Dec. 2022London Area, United Kingdom
Data Engineer
InfosysData Engineer
Aug. 2017 - Sep. 2019Hyderabad, Telangana, India
Intch is a Professional Networking App for the Future of Work
300k+ people
130+ countries
AI matching
See more people like Manoj on Intch
IT
453430 people
16
Senior software engineer
19
Project manager @ Zois Energy limited
20
Project and business Manager
ITData Scientist
35854 people
19
Project manager @ Zois Energy limited
18
Financial Consultant @ Standard capital corporation
121
Investor Relations Manager @ ExxonMobil