Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app
Work Background
Data Engineer
Cooperative ComputingData Engineer
Jan. 2024United Arab Emirates- Client : BinDawood and Danube - Designed and automated end-to-end data pipelines to enable scalable data processing and analytics. - Hands-on experience with Databricks, PySpark, SQL Server, and building workflows, dashboards, and analytical reports. - Developed deep business understanding across Sales, Purchase, Inventory, Order, and Consumer datasets to drive data-driven decisions. - Collaborated on fact and dimensional data modeling to support robust data warehousing and reporting systems.
External Consultant - Data Engineering
Alpha DataExternal Consultant - Data Engineering
Jun. 2023 - Aug. 2023United Arab Emirates- The project is for client MANAFTH (ICP) and it is a limited-time contract-based. - The overall data is around 27 TB, and the streaming frequency is 25 mb/sec. - Responsible for developing, maintaining, and automating new API (Advanced Passenger Information). - Develop the new system from scratch, along with passing the test cases. - Working with Kafka CDP, Pulsar, Spark, and Oracle to build end-to-end pipelines. - Acknowledge and design the refresh mechanism for the failed streaming data. - Configure the code to handle dependencies within the database. - Implement encapsulation and data hiding to secure the data and the credentials within the code.
Data Engineer
DGlobal Data Engineer
May. 2023 - Jan. 2024
Senior Data Engineer (Limited time contract)
HappyFreshSenior Data Engineer (Limited time contract)
Jul. 2022 - Aug. 2022- Conducted data cleaning to rid the system of old, unused data, or duplicate data for better management and quicker access. - Worked on creating new data pipelines using Data bricks. - This was a contract based job.
Data Engineer
Turing.comData Engineer
Jun. 2022 - Dec. 2022- Worked on improvements of products and processes along with Optimizations - Automated tasks to get the most out of the data pool
Consultant (Data Analytics) - Data Engineer
Systems LimitedConsultant (Data Analytics) - Data Engineer
Jan. 2022 - Jun. 2022• Participated as combo of Devops and Data Engineer, providing solutions for automation in big data processes, worked towards operational automation along with pipeline design and development • Used Talend with Spark as a data integration tool. • Played dual role as a Data Engineering and Cloud Engineering consultant, also responsible for leading Delivery Management and Data Pipelines team • Connected with clients to gather business requirements and translating them to optimized solutions • Worked with various cross functional teams to attain successful and timely delivery • Created Business Intelligence reports to report business KPIs •Delivered new and enhanced data-centric solutions by applying software development lifecycle in an agile environment • Performed a key role in problem identification, root cause analysis & devising strategies for future prevention • Responsible for documenting user stories and issue reporting/tracking using JIRA and documentation using Confluence
Junior Consultant - Data Engineer
Systems LimitedJunior Consultant - Data Engineer
Jan. 2021 - Dec. 2021Lahore, Punjab, Pakistan- Data Engineer in big data team, worked on Spark, Hadoop, AWS cloud, GCP, Hive, Airflow, Nifi, etc. - Worked along with team on Data Architecture
Data Engineer
Visionet Systems Inc.Data Engineer
Apr. 2020 - Jun. 2022- Implement methods to improve data reliability and quality. - Build data systems and pipelines after evaluating business needs and objectives. - Worked on designing data pipelines, processing data, getting insights, ingesting data into Data lakes using tools like Spark, AWS, NIFI, Airflow, Hive, Python and R - This is part of Systems Limited
Software Engineer
Systems LimitedSoftware Engineer
Jan. 2020 - Dec. 2020Lahore, Punjab, Pakistan- Developed, designed ETL pipelines as being part of engineering team
Associate Software Engineer
Systems LimitedAssociate Software Engineer
Jun. 2019 - Dec. 2019Lahore, Punjab, Pakistan- Learnt the basics and SOPs of working in data team - Developed some APIs to be used in data pipelines
Data Science Intern
MTBC CareersData Science Intern
Aug. 2018 - Aug. 2018Rawalpindi, Punjab, Pakistan1. Work with Computer vision techniques along with some JavaScript work. 2. Implemented new research paper algorithms to check the performance.
Cooperative Computing
United Arab Emirates
DGlobal

Requests

Touchpoint image
0
Looking for a Job
Seeking Data/ETL Engineering Opportunities
Intch is a Professional Networking App for the Future of Work
300k+ people
130+ countries
AI matching
See more people like Rajnesh on Intch
IT
1026939 people
19
CEO @ Al Intisar Solutions (Private) Limited
21
Unit Head HR Off boardings and Services @ Faysal Bank
17
SQA Engineer @ Shyld AI
ITData Engineer
74865 people
15
Senior Data Engineer @ Kavtech Solutions (Private) Ltd.
16
Data Scientist / Data Analyst @ Idara i Talim o Agahi
16
CEO @ Khyber Dynamics