ExpertVoiceData Engineer IV
May. 2015 - Aug. 2024Salt Lake City, UTCreated and maintained 1500+ data pipeline ETL/ELT jobs to support data integration needs for ExpertVoice. Collected, cleansed, prepared and loaded data from a variety of sources into the Redshift data warehouse and MySQL transactional databases. • Served as the Tech Lead and Mentor for members of the Data Engineering and BI Analyst teams. Filled in as the Manager of Business Intelligence, twice. Performed employee performance reviews and interviewing/hiring.
• Debugged and fixed complex job failures due to upstream/ downstream changes.
• Designed / developed BI environments to support Tableau reporting.
• Maintained and optimized Redshift cluster. Created and supported dev environments for other Engineers/Analysts.
• Designed and created tables in data warehouse for proper storage and reporting with Tableau. Developed and tuned database queries for optimal performance.
• Ensured data quality and accuracy with both internal and external stakeholders.
• Lead the efforts to gather analytics collector events for the ExpertVoice Advocacy Platform. This involved collecting, structuring, sanitizing, and loading ~7 million events/day into Redshift. TECHNOLOGIES: • SQL Pro: PostgreSQL, MySQL, HiveQL, T-SQL, PL/SQL
• AWS Tech: Redshift, S3, Spectrum, Glue, EMR, EC2, Aurora RDS, Athena
• Tech used/familiar with: Linux/ Ubuntu, MageAI, Pentaho Data Integration (PDI), shell scripts, Bash, Cron, HDFS, Hive, Tez, Java, JavaScript, Python, Docker, JSON, Tableau, Git, Jira, Postman, APIs, cURL