Abdul Djafar - Data Engineer, Love Bonito

Keep in touch with meI'm using Intch to connect with new people. Use this link to open chat with me via Intch app

Work Background

Love, BonitoData Engineer

Sep. 2023Singapore · Remote

QuipperData Engineer

Nov. 2022 - Nov. 2023Japan · RemoteEnhanced and optimized existing data infrastructure to ensure maximum efficiency. Developed strategies for improved monitoring of data infrastructure performance. Leveraged Google Cloud Platform to design and implement new data pipelines, enhancing data processing capabilities. Automated data infrastructure creation using Terraform for streamlined operations. Transitioned from bash to Rust for improved performance in pipeline management.

AutonomicProduction Engineer

Mar. 2022 - Mar. 2023Greater Toronto Area, Canada · Remote• Provided 24/7 on call rotation assistance for the Apac timezone • Developed and implemented automated tools, improving efficiency and productivity across production processes.

EvermosData Engineer

Jan. 2022 - Mar. 2022Remote• Successfully migrated pipelinewise dag (Apache Airflow) from BashOperator to KubernetesOperator, resulting in improved pipeline performance and reliability. • Maintained and optimized data infrastructure comprising Apache Airflow, Redshift, Rudderstack, and Kubernetes, resulting in efficient and effective data processing and storage. • Implemented string matching process on top of Apache Spark, which enhanced the accuracy of data analysis and reporting. • Developed a Grafana dashboard for monitoring Apache Airflow, enabling quick identification and resolution of issues. • Deployed AWS Data Migration Service for data ingestion and combined it with Apache Airflow, significantly improving data management and integration. • Created Slack alerting for AWS Data Migration Service using AWS Lambda function with AWS SNS, ensuring timely notification of any potential data issues. • Automated termination of locking query in Redshift using PythonOperator in Apache Airflow, saving time and increasing efficiency.

Raijin TechnologiesBack End Developer

Nov. 2020 - Mar. 2022Remote• Developed and maintained a REST API for frontend services, ensuring seamless communication between the backend and frontend systems. • Designed and implemented scalable infrastructure solutions for both frontend and backend systems to improve overall performance and efficiency. • Established a robust CI/CD pipeline to automate development processes, resulting in faster delivery of high-quality features. • Integrated alerts with Discord to streamline communication among team members, facilitating prompt issue resolution and minimizing downtime.

All Data InternationalData Engineer

Jan. 2020 - May. 2021On-site• Streamlined internal team's data processing systems resulting in increased efficiency and accuracy. • Designed and implemented a comprehensive data pipeline for a key client resulting in faster data delivery times. • Developed a highly effective search engine solution for a major client resulting in improved customer experience and satisfaction. • Conducted successful proof-of-concept projects in Backend and data engineering, contributing to the company's ongoing innovation and growth.

Netzme | Netzme Kreasi Indonesia, PTSite Reliability Engineer

Feb. 2019 - Dec. 2019Jakart · On-site• Developed and implemented internal tools to improve operational efficiency • Established a robust CI/CD pipeline resulting in faster and more reliable software delivery • Processed and analyzed data to identify areas for optimization within the infrastructure • Maintained and improved the reliability of our company's infrastructure • Designed and built a monitoring dashboard to track system performance and proactively address issues.

DattabotBack End Engineer

Feb. 2018 - Feb. 2019Greater Jakarta Area, Indonesia · On-site• Developed and implemented efficient CI/CD infrastructure, streamlining development processes. • Designed and deployed Docker containers for AI services, facilitating seamless scalability and deployment across various environments. • Created innovative AI services that enhanced the company's product offerings and provided unique value to clients. • Constructed robust back-end systems to effectively connect with AI services and enable smooth functionality.

DattabotSite Reliability Engineer

Jun. 2016 - Dec. 2017Greater Jakarta Area, Indonesia• Collaborated with Data Engineer to optimize analytics queries in Apache Impala and Hive. • Developed automation tools for efficient parsing of random XML data. • Implemented Cloudera Platform to build a Hadoop cluster for clients, resulting in improved performance and scalability. • Configured Postgres database for seamless deployment. • Designed and executed automation solutions for AWS infrastructure, reducing manual workload and increasing efficiency. • Established rigorous unit testing protocols for infrastructure automation, ensuring high-quality deliverables.

Intch is a Professional Networking App for the Future of Work

100k+ people

130+ countries

AI matching

Get Intch if you'd like to

📝

Get Recommended to New Customers

👋

Connect with Like-Minded People

💸

Raise Capital

🚀