Madiha Khalid

Senior Data Engineer

ITEngineerPythonSparkHadoopHiveSQLData EngineerGermany

Madiha Khalid is a seasoned professional in the field of data engineering with a deep understanding of data architecture.

Feedback from Madiha’s ex-colleagues

Let me see

Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app

Network Power<100 people

Roles

💸50%

Marketing

🔥37%

Startup Founder

✔️37%

Geos

🇧🇪12%

Belgium

🇨🇱12%

Chile

🇦🇪12%

United Arab Emirates

Work Background

Dataworkz GmbHSenior Data Engineer

Apr. 2023Hamburg, Germany

JimdoSenior Data Engineer

Nov. 2021 - Apr. 2023Hamburg, GermanySkills: Unstructured Data · Passionate about Work · Datadog · Cloud Infrastructure · Data Ingestion · Communication · Defining Requirements · Software as a Service (SaaS) · AWS CloudFormation · Transact-SQL (T-SQL) · Extract, Transform, Load (ETL) · Apache Spark · Apache Kafka · Amazon Web Services (AWS) · Python (Programming Language)

JimdoData Engineer

Nov. 2018 - Nov. 2021Hamburg Area, Germany- Design, developed and maintain ETL Pipeline using Python, Docker and Jenkins over AWS Infrastructure - Moved to new Infrastructure solution to schedule ETL pipeline on Apache Airflow using Kubernetes Cluster with CI/CD pipelines deployment. - Continuously working with stakeholder and Analyst to provide reliable and high quality data in AWS Redshift - Data Integration using REST API from various Tools Facebook, Google AdWords, Zendesk, CRM, Braze etc - Optimised AWS Redshift cluster resource utilization and SQL queries tuning to improve the performance - Parallelise ETL Jobs using Dask framework to improve the runtime performance of jobs - Convert existing full copy data load ETLs to incremental load of legacy data pipeline - Maintain infrastructure as a code data infrastructure in AWS stack using Cloudformation template - Work in an agile using scrum framework

Eurecat - Technology Centre of CataloniaBig Data Developer Researcher

Dec. 2017 - Sep. 2018Barcelona Area, Spain- Design and Implement Scalable Big Data Lambda Architecture Using Apache Spark, Cassandra and Elasticsearch for the Water management sector of Catalonia. - Building Data Lake using Apache Cassandra Integrate different financial data sources i.e. SAP ISU, Oracle Informix. - Applied extensive data analytics using Apache Spark to calculate water consumption, bills, supplying entities. - Elasticsearch used to persist the results for fast query results.

Barcelona Supercomputing CenterResearch Student

Feb. 2017 - Oct. 2017Barcelona-Design and Implementation of Kappa Architecture using microservices. -Analyse mobility data pattern from live stream of data from various sensors. -Build trajectories and Implement Markov Chain real-time udpated model to predict the next location of a moving object. - Manage backend architecture for Big Data (Velocity and Volume) using Apache Kafka , Apache Cassandra and Apache Flink. - Deployment of architecture into Amazon Web Service EC2 instances for Apache Kafka and Cassandra and Hadoop EMR for Apache Flink

MobilinkExecutive Business Intelligence & Solutions Development

May. 2014 - Sep. 2015LahoreDesign & Develop web based business applications. Responsible for different business process automation. Design BI application technical solution based on business requirement and design. Design ETL Procedures in SQL server integration services. Create complex data solutions by leveraging database design, performance tuning, query optimization, indexes, data migration tools, and data analysis of back end data generated by products and services. Provide support to the clients for existing application. Big Data Analysis: NPS reporting on millions of customer’s feedback record. Projects: Mobilink’s Net Promoter System by Bain & Company -Customer Feedback Loop CFL, Franchise Portal, ZCCM feedback portal

Warid TelecomExecutive Engineer Service Development

Jan. 2013 - May. 2014Design and develop Enterprise Level Automated Software for performance monitoring. Develop KPIs Monitoring Dashboard web based for technical sub-departments. Develop advance level SQL Queries (Bulk import, Merge, Cursor, Stored Procedures.) Project Documentation, Project scope, Architecture Diagrams. Oracle and SQL Server database maintenance, backups & restore. Big Data Analysis: Report generation on millions of subscriber’s data. GSM Network data extraction and generate reports on different criteria.

Warid TelecomNSS Planning Intern

Aug. 2012 - Nov. 2012Lahore Pakistan

Eycon Private LimitedWeb Development

Oct. 2011 - Jul. 2012Lahore

Requests

Personal Pitch

Expertise in Data Engineering

Intch is a Professional Networking App for the Future of Work

300k+ people

130+ countries

AI matching

Get Intch if you'd like to

📝

Get Recommended to New Customers

👋

Connect with Like-Minded People

Reach Top Niche Experts

⚡

Find Jobs on a Hidden Market

💼

Find a Perfect Co-Founder

🙌

Find a Trusted Mentor

🤝

Hire Top Global Professionals

See more people like Madiha on Intch

453430 people

Founder & CEO @ The Beyond Ego Collective (Company in Formation)

Computer Science Expert Subject Area: System Integration

Director Engineering @ Mapp Digital

ITData Engineer

35616 people

Technical Architect, Backend Engineering @ Code Cartel

Head of Development @ SiNetCon GmbH

Gründer // Inhaber @ Joram Höfs Consulting