LinkedIn | Resume | Github | Twitter | Website

Summary of experience

I have been working professionally as a software engineer for around 8 years. For around 6 years, I have been dealing with data and ML using Python/SQL stacks.

Currently, I am working towards improving data quality, observability and security for my company.

I have worked with a product which was using Snowflake data warehouse and AWS services. Implemented the warehouse, integrated for data ingestion and used it for productionizing ML models. Did the whole design, did almost 90% of the implementation. Have also done an implementation for a different part of the system using Apache Spark for ML.

I have experience on JVM ecosystem (microservices, APIs, server to server). I am used to interact with data scientists for their requirements like ad-hoc data requests, setting & manage BI tools like Apache Superset for their use and productionizing ML models.

I have experience working remotely since late 2017. Since 2015 I have worked with geographically & time zone distributed teams. Worked in Agile mode for 5+ years. Worked in team containing front end, back end, QA, product and UX directly interacting with all.

Technical

• Cloud
  • Major experience with AWS. Have worked with GCP for around a year.
  • Have setup & used Jenkins for deployments, builds etc.
  • Have setup & used Ansible, Terraform, Kubernetes to manage Infra on GCP.
  • Have used kibana, AWS Cloudwatch, GCP Monitoring for for monitoring services.
  • Have used prometheus, grafana, AWS Cloudformation a bit
• Data tools - Have worked with Apache Airflow, Superset, Spark ML, Sagemaker, RDBMS (Mysql, PostgreSQL), NoSQL (Apache Druid, DynamoDB), Data Warehouse (AWS Athena, Snowflake)
• Data tools (some exposure) - great expectations, LinkedIn's datahub for data quality & data observability, Redis, Elasticsearch, Aerospike
• Streaming data - I have dealt with event-driven processing via kinesis, Kafka and AWS Lambda but not stream processing
• High Performance - I have developed a web application that worked at 100K QPS at less than 10ms latency. This involved a group of cluster of applications in micro service architecture - some services (in Java), other databases (apache druid) deployed on AWS.
• Software Design - I have done design for many big features spanning multiple microservices which were deployed in AWS.
• Testing - I have done functional testing using GEB automation framework & Spock, unit testing using Spock, some performance testing using Jmeter.
• Other - I have contributed a little to some open source projects. Have some idea of Blockchain tech. Have played around with many programming languages although not proficient in them - Clojure, Haskell, Scala

Visa Status

• I have a valid B1/B2 Visa for USA until 2027

My Opinions & thoughts