Instituto AtlรขnticoData Engineer
Aug. 2022Fortaleza, Cearรก, Brasilโข ๐๐ช๐ฆ ๐๐ฐ๐ผ๐๐๐๐๐ฒ๐บ ๐ฃ๐ฟ๐ผ๐ณ๐ถ๐ฐ๐ถ๐ฒ๐ป๐ฐ๐: Worked extensively within the ๐๐ช๐ฆ ecosystem, primarily utilizing S3 buckets, EMR, and Redshift, ensuring efficient storage, processing, and retrieval of large datasets.
โข ๐๐ง๐ ๐ฃ๐ฟ๐ผ๐ฐ๐ฒ๐๐๐ฒ๐ ๐ฎ๐ป๐ฑ ๐ฃ๐ถ๐ฝ๐ฒ๐น๐ถ๐ป๐ฒ ๐ ๐ฎ๐ป๐ฎ๐ด๐ฒ๐บ๐ฒ๐ป๐: Conducted ETL processes using ๐๐ฝ๐ฎ๐ฐ๐ต๐ฒ ๐๐ถ๐ฟ๐ณ๐น๐ผ๐ and managed data pipelines with Azure Pipelines and Terraform scripts, leveraging ๐ฃ๐๐๐ต๐ผ๐ป for task automation and execution.
โข ๐๐ด๐ถ๐น๐ฒ ๐ ๐ฒ๐๐ต๐ผ๐ฑ๐ผ๐น๐ผ๐ด๐: Utilized Agile methodology for effective project management and team collaboration, ensuring timely and successful project delivery.
โข ๐ ๐ผ๐ฑ๐ฒ๐ฟ๐ป ๐๐ฎ๐๐ฎ ๐ฆ๐๐ฎ๐ฐ๐ธ ๐๐ฒ๐๐ฒ๐น๐ผ๐ฝ๐บ๐ฒ๐ป๐: Collaborated on developing a data pipeline for Google Analytics using a modern data stack with dbt and Dagster. Contributed to implementing data pipelines with CI/CD and observability, processing hundreds of gigabytes of data daily, ensuring efficient and reliable data processing.
โข ๐๐ฎ๐ฟ๐ด๐ฒ-๐ฆ๐ฐ๐ฎ๐น๐ฒ ๐๐ฎ๐๐ฎ ๐๐ฎ๐ป๐ฑ๐น๐ถ๐ป๐ด: Leveraged these technologies and processes to ensure the efficient handling and transformation of large-scale data, making it readily available for business intelligence and decision-making.