AccentureData Engineer
Oct. 2019 - Aug. 2021LatviaRunning various ETL processes and tasks in distributed environments: data ingestion, streaming, processing and task scheduling on Cloud platforms and Hadoop ecosystem. Data modelling and data quality management for relational and NoSQL databases.
Technologies: Python, SQL, Scala, Spark, Hadoop, Hive, Snowflake, Kafka, Airflow, Bash, Docker, REST API, PowerShell. AWS: DynamoDB, Redshift, Glue, EMR, Lambda, CloudFormation. Azure: Data Factory, HDInsight, SQL Server.