Hi! Thanks for taking the time to read our job description.

COMPANY OVERVIEW

We're Kolena, an early stage startup building the first ML testing platform in the world! Our mission at Kolena is to build a dynamic test harness to empower teams to rigorously test their model behavior and ship with confidence.

One of the hardest problems that ML teams face is the lack of ability to identify (and track) the success and failure modes of their models. Data scientists currently rely on statistical metrics like precision, recall, F1 score, etc. to understand areas of strengths and weaknesses. However, these techniques leave huge blind spots that fail to capture the full behavior of the model. Metrics reported in terms of these aggregated statistics don’t provide information on failures across various types of cases, attributes, and scenarios. Even when a model is improved to report a higher overall accuracy, surprising shifts can occur in the distribution of errors — including new ones. Our mission at Kolena is to solve this problem by building a dynamic test harness, empowering teams to proactively define quality for their models — before they deploy to prod!

We've recently raised a large seed round from top tier funds in the Silicon Valley, and now we are building the product with our early customers and building our initial team of engineers. If you are passionate about defining the standards for how companies think about model quality, we would love to hear from you!

ABOUT THE ROLE

Our company is working closely with our customers / design partners in the CV and NLP space to build a testing platform that will allow teams to organize their data, build test cases, orchestrate test runs, analyze results, and communicate summaries. We're looking for someone who can work closely with our solution engineers and design partners to grok their ML testing pains, and to design and build platform features to making their testing flow painless.

On the non-technical side, we're looking for someone driven and excited, but also not afraid to have some fun and bring their own personality to the company. We plan on working on this for the long haul, so our goal is to build an authentic culture that includes your passions and personality. We want you to be proud to be part of Kolena.

You'll have the opportunity to work with a talented founding team, with experience building product and leading development at Amazon, Palantir, Twilio, and Rakuten. We've also built a previous startup (Synapse Technology Corporation) to a successful exit. Moreover, as one of our initial engineers, you will have the agency to influence our software development process — ranging from the technology, to the architecture, to the meta-processes of how engineers work.

QUALIFICATIONS

As a small startup, we think the most valuable initial engineers are generalists who are excited to learn on the job. As such, we aren't looking for the unicorn candidate who checks every box on this list, but rather someone who grasps many of these concepts well.

• Bachelor's degree in Computer Science, Mathematics, Physics, Engineering, Statistics, or other quantitative discipline.
• 4+ years of relevant experience working in software development and systems design
• A compelling subset of the following characteristics:
  • Proficiency in Golang
  • Bias toward writing well documented and well tested code
  • Experience with working independently to develop software with minimal hand holding
  • Familiarity with SQL and NoSQL database systems
  • Familiarity with Python CV / NLP / ML libraries
  • Experience with Cloud platform architectures (AWS, Azure, GCP) and knowledge of Kubernetes
• Bonus:
  • Familiarity with React / Redux / Typescript

Interested? Email [email protected] with your resume and a story about an interesting engineering problem that you've worked on.