Mentat InnovationsLead Software Engineer
Jan. 2016 - Dec. 2016Athens- Architecting, designing and developing light weigth products using the following tech stack. Apache Flink, java 8 , redis, rabbitmq, elasticsearch for real time data processing,aggregation and ingestion ,reporting
- Analyzing big data sets using the following tech stack , Apache Spark (scala API, spark -SQL ) , Apache zeppelin , Elasticsearch with the help of ES-hadoop library
- Working with streams of proxy logs using apache spark 2.0.0 streaming API, kafka, elasticsearch ,logstash.
- Interpreting basic modelling from python/r code base to scala.
- Setting up Vms, or Dedicated servers in the cloud, (AWS , hetzner) using either docker or standalone setups for Elasticsearch, Spark, redis
- Active strong involvement on creating the specification for mini products used for transaction data set analysis
- Mentoring junior engineer for development tasks,