Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app
Work Background
Truelogic SoftwareSenior Data Engineer
May. 2024• Developed and implemented a robust data pipeline to extract, transform, and load data
from the LinkedIn Learning API, leveraging AWS Lambda and Python for data processing
and flattening.
• Automated the process of uploading transformed data to AWS S3, optimizing data
storage and retrieval.
• Deployed the Lambda function to AWS Lambda using Jenkins for continuous integration
and deployment.
• Configured and created an IAM role through Terraform, ensuring secure and scalable
infrastructure setup.
• Orchestrated end-to-end data processing workflows using Apache Airflow to run a 2-
year historical data extraction, followed by weekly updates, integrating with Snowflake
to store and manage processed data.
• Designed and executed a DAG workflow to handle AWS Lambda's 15-minute runtime
limit, ensuring seamless and efficient data processing without interruption.
• Ensured data consistency and quality throughout the pipeline by implementing
automated validation checks.
• Leveraged Fivetran connectors to automate the creation of Snowflake tables,
simplifying the data ingestion process.
• Monitored and resolved DAG errors using Hightouch, ensuring smooth and
uninterrupted data workflows.
• Responded to alerts via PagerDuty, resolving issues in real-time to ensure the reliability
of data pipelines and DAG runs.
ApplaudoSenior Data Engineer
Jan. 2024 - Nov. 2024Guatemala City, Guatemala, Guatemala• Ingested data from the Zoho Desk API using Python, automating the extraction process
and storing data locally as CSV files for initial analysis.
• Designed and implemented an interactive dashboard in Looker Studio, connecting directly
to a Google Sheets document containing mockup data, allowing stakeholders to visualize
key metrics and insights.
• Optimized data handling by creating a custom script in Google Sheets to upload data into
BigQuery, improving performance and scalability for dashboarding and reporting.
• Performed data transformations in BigQuery, creating views to facilitate advanced
calculations and ensuring data was structured efficiently for reporting purposes.
• Integrated BigQuery tables and views into Looker Studio, enabling real-time analytics and
more dynamic dashboarding capabilities.
• Conducted in-depth analysis of pre-existing BigQuery views created by other team
members, assessing for consistency, optimization, and efficiency improvements to ensure
seamless integration with additional Looker Studio dashboards.
• Collaborated with cross-functional teams to maintain data quality, resolve discrepancies,
and enhance dashboard performance, ensuring data-driven decision-making for
government projects.
Vistra Corp.Data Engineer
Aug. 2022 - Oct. 2022• Orchestrated the migration of databases from Snowflake to PostgreSQL, enhancing
efficiency.
• Refine the ETL process by updating Talend jobs, contributing to improved data handling.
• Developed data monitoring and alerting systems, reducing data processing errors by 25%
and improving data pipeline reliability.
• Implemented data encryption protocols, ensuring compliance with industry security
standards and protecting sensitive data.
Allied Global Technology ServicesSenior Software Engineer
Apr. 2022 - Oct. 2023Remote• Spearheaded various implementations for legacy software, utilizing .NET for backend,
JavaScript for frontend, and SQL Server for the data layer.
• Executed data migrations and optimizations, ensuring data quality and consistency across
platforms.
• Implemented automated testing procedures, reducing manual testing efforts by 30% and
increasing overall software reliability.
• Enhanced Agile methodologies into the development process, leading to a 20% increase in
project delivery efficiency.
Government Brands, LLCSenior Software Engineer / Senior Data Engineer
Apr. 2022 - Oct. 2023Guatemala, Guatemala• Spearheaded various implementations for legacy software, utilizing .NET for backend,
JavaScript for frontend, and SQL Server for the data layer.
• Executed data migrations and optimizations, ensuring data quality and consistency across
platforms.
• Implemented automated testing procedures, reducing manual testing efforts by 30% and
increasing overall software reliability.
• Enhanced Agile methodologies into the development process, leading to a 20% increase in
project delivery efficiency.
StrongMindBack End Developer
May. 2021 - Apr. 2022• Maintained and enhanced front and back end features for the StrongMind webpage.
• Developed new code using .NET, JavaScript, SQL, and Python to implement visualization
changes and optimize database connections.
• Automated data upload processes using AWS Lambdas and Databricks, ensuring
streamlined data cleaning and warehousing solutions with Snowflake.
• Designed and implemented a data caching system, reducing server load by 20% and
improving overall application performance.
PinterestFinOps Analytics Engineer
Feb. 2021 - Feb. 2022• Led query migrations from Presto to SparkSQL, improving efficiency and sustainability
within production tables.
• Analyzed data to provide actionable insights for data consistency and accuracy,
facilitating robust data cleaning using Databricks for in-house data visualization tools.
• Developed and implemented cost optimization strategies, reducing cloud infrastructure
costs by 15% while maintaining performance and reliability.
• Implemented anomaly detection algorithms, reducing the time to detect and respond to
abnormal spending patterns by 30%.
BairesDevSoftware Engineer
Feb. 2021 - Feb. 2022Developing query migrations from Presto to SparkSQL to improve efficiency and sustainability with the production tables. Analyzing data to provide insights on what actions can be performed to create data consistency and provide more accurate data to stakeholders.
3Pillar GlobalSoftware Engineer
Nov. 2020 - Oct. 2022Maintaining front end and back end features for the webpage. Developing new code to implement new changes in visualization and optimizing connections with the databases. Consuming API's, developing lambdas to automate processes for data upload and providing data warehousing solutions.
Freelance, self-employedSoftware Developer
May. 2018GuatemalaExecute and develop multiple projects for clients inside US and Europe where I implement different solutions depending on clients needs using JavaScript and Python for Data Analysis, HTML, CSS and C# for Web Development and SQL for Database Management.
Intch is a Professional Networking App for the Future of WorkSee more people like Ricardo on Intch
300k+ people
130+ countries
AI matching
Get Intch if you'd like to
1026939 people
19
Automation & Data Engineering/Project Manager PMP/BigData Transition Architecting Scalable Data Workflows
15
Quality Agent @ Bombardier Aerospace
16
CRM Strategy & Business Intelligence Consultant y Omnichannel Operations Manager
114118 people
19
Automation & Data Engineering/Project Manager PMP/BigData Transition Architecting Scalable Data Workflows
15
Quality Agent @ Bombardier Aerospace
18
IT Senior Vicepresident @ Banamex