GovTech EduSoftware Architect / Senior Software Development Engineer (Backend/Data)
Dec. 2020 - Dec. 2022Jakarta, IndonesiaLeveraged my technical expertise that contributed to the design and development of a high-performance data collection system capable of handling high-volume, transaction state data. This system is capable of processing over 10,000 complex transaction inputs per minute with less than 5ms latency, utilizes gRPC and GoLang to optimize data ingestion and storage in PostgreSQL, enabling seamless data distribution to BigQuery for in-depth analysis. Deployed with efficient resource utilization, this system is designed for scalability, allowing for future expansion to accommodate increasing data volumes and processing demands. Led the backend team in migrating data collection services from PostgreSQL to BigQuery, utilizing PubSub as a message broker. This optimization significantly reduced latency by up to 5 times, leading to substantial resource savings.