PleecoSenior Software Engineer/Tech Lead
Oct. 2017 - Mar. 2020Greater New York City AreaFinancial Data Analysis Software • Created and implemented Fund Transfer Pricing calculation algorithm for financial data analysis. Improved performance and memory consumption over baseline implementation over 100x, measured by benchmarks. • Implemented scalable Cloud-enabled distributed computing engine for the Algorithm. • Technologies and Skills: Java, Tinkerpop Graph API, SQL, NoSQL, AWS. Pleeco Currents. Interactive data exploration and transformation cloud-native Platform. • Backend Tech Lead. Coordinated work of several backend developers over storage subsystem. • Implemented tiered Distributed Storage and Computation engine for the Platform. Improved performance and processed data volumes 1000 times over baseline prototype, measured by benchmarks (TPC-DS). • Implemented flexible Connector Engine to access various data sources. Improved performance 100x over baseline, measured by data ingestion benchmarks. • Implemented data versioning through snapshotting and data sandboxing though Git-like branching. • Implemented distributed SQL engine by developing storage connectors to publicly available components. • Key technologies: AWS, Amazon S3, DynamoDB, Apache Kafka, Apache Cassandra, Memoria (see below), Apache Arrow, Presto, Java, Graal, C++14, JavaScript, Python, Node.js, SQL, OLAP, Apache Calcite, Presto SQL Engine, Mesos/Marathon, Docker.