act digitalData Specialist
Sep. 2024São Paulo, São Paulo, BrazilData Specialist on projects for AB InBev, working within an international team and responsible for developing complex, scalable data solutions. I leverage advanced tools such as Azure Data Factory, Databricks, and PySpark, applying object-oriented programming (OOP) to efficiently handle large data volumes. My main responsibilities include: Integrating multiple data sources and systems via APIs, ensuring continuous data updates and enabling rapid, accurate analysis. Conducting data cleaning, organization, and transformation using big data techniques and hash tables, ensuring data consistency and optimization for analysis. Building robust, scalable pipelines with Azure Data Factory and Databricks, processing large-scale data with PySpark to support critical operations and real-time analytics. Using Databricks and Azure to develop reusable and efficient notebooks, providing insights and meeting the strategic needs of business teams. Implementing hash tables for efficient data manipulation, applying OOP to develop scalable and well-structured data solutions.