Cardiff, Wales, United KingdomDesigned and implemented scalable and efficient ETL (Extract, Transform, Load) processes to move and transform data from diverse sources into a centralized data warehouse. Developed and maintained data models to support business requirements, ensuring optimal performance and data integrity. Established and enforced data quality standards, conducting regular data quality assessments and implem...
Pinterest-Data-Pipeline-Project
• Developed an end-to-end processing in Python based on pinterest’s experiment processing pipeline
• Implemented based on Lambda architecture to take advantage of both batch and stream-processing
• Technologies used: Kafka, HBase, Presto, FastAPI, Spark, PostgresSQL, Prometheus and Grafana Formula1-Data-Processing-with-Azure-Databricks
• Developed a robust and ...
City of London, England, United Kingdom• Collaborated throughout systems development lifecycles, from requirements gathering to production releases.
• Developed wireframes, site maps and content inventories for new website designs.
• Liaised with stakeholders to verify technology alignment, recommending solutions against project specifications.
• Documented process flows and developed requirements for functional improvements.
• An...