Senior Data Engineer | Data Platforms & ETL (Python, Scala, Spark, Azure)
Verified
Senior Data Engineer with 10+ years of experience building and optimizing data platforms and pipelines.
I help companies:
- design scalable data platforms (Spark, Python, Scala, Azure)
- design and build reliable, scalable ETL pipelines
- integrate complex data sources and design robust data models
- implement data governance and metadata solutions
Background includes large-scale environments and hands-on development across backend and data engineering.
Selected achievements:
- Designed and implemented scalable data pipelines on distributed Spark clusters, enabling reliable processing of complex data workflows
- Built data governance and metadata integration solutions across Azure Purview, Dremio, and Apache Atlas, improving data visibility and control
- Developed automated data pipeline orchestration using Apache Airflow, reducing manual intervention and increasing operational stability
Open to part-time projects where I can help bring clarity, stability, and performance to data systems.More...