Years of experience: 9
ETLDatabase ManagementDatabricksSparkEngineerNoSQL
Trust Score
Exceptionally trusted; proven professional excellence.
Rafael's Career Path
Feb. 2023 -Present
Avenue CodeSenior Data Engineer
Rio de Janeiro, BrasilDigital Transformation Project: migration of SSIS packages from on-premise infrastructure to Azure for an international client (Canada). Phase 1: Lift & Shift
- Successfully migrated SSIS packages to Azure, using Azure Data Factory for orchestrations, Azure SQL for data storage, and Databricks for scalable data processing.
Phase 2: Refactoring
- Refactored codebase from C# to Python, enhancin...
Jul. 2021 -Feb. 2023
Ame DigitalTech Lead Analytics Engineer
Rio de Janeiro, BrasilContinued Excellence in Core Responsibilities:
- Maintained high standards in executing all previous roles, ensuring the continued success and efficiency of data processes and projects. Team Coordination & Leadership:
- Led and coordinated data analysts across multiple squads, including Loyalty, Finance, Anti-Fraud, Compliance, and Marketing. Ensured the adoption of best practices across team...
Mar. 2020 -Jul. 2021
Ame DigitalSenior Analytics Engineer
Rio de Janeiro, BrasilETL Development & Data Integration:
- Developed and maintained diverse ETL processes, facilitating seamless data movement across various platforms: - Transferred files from FTP servers. - Integrated with Eventhub Kafka for real-time data streaming. - Sent data to Eventhub and API endpoints. - Managed data exchanges via Azure DataShare. - Accessed and processed files from EC2 and Blob Storage....