AH INFOTECH LLCData Engineer
Sep. 2019New York, New YorkDEVELOPMENT & AUTOMATION • Designed and automated ETL pipelines using AWS Apache Airflow and Python to process raw data, schedule workflows, and eliminate manual intervention, improving reporting speed and reliability. • Performed data extraction from AWS S3, cleaning and transformation in Apache Spark, and enrichment for external database integration. • Developed anomaly-detection software in Alteryx to alert management of missing data, preventing reporting disruptions. • Built and automated ETL pipelines with AWS Apache Airflow and Python to process and clean raw data, scheduling workflows to eliminate manual effort and deliver faster, reliable reporting. USER SUPPORT • Created and automated SQL queries and procedures for monthly financial and business reporting, reducing manual workload. • Built advanced Tableau dashboards for demographic and financial analysis, supporting marketing and data-science teams. • Cross-functional team collaboration with the marketing and data-science teams.