About Ultralight
At Ultralight, our mission is to empower providers to help their patients live their healthiest lives today. We're building the future of personalized medicine by giving AI superpowers to clinicians. Think Claude Code or Cursor, but for doctors.
We are built a sophisticated AI platform that powers functional, integrative, and longevity medical practices. Our platform combines large language models, healthcare-specific agents, and human expertise to empower practitioners to deliver high-quality preventive care that learns, reasons, and adapts to each patient's unique needs.
We are powering a community of forward-thinking healthcare professionals committed to transforming the industry. Our journey is fueled by a passion for better healthcare—for providers and patients alike. Together with our partners, we're not just imagining the future of healthcare. We're creating it.
Role Overview
As an Applied AI Engineer, you will be instrumental in developing and refining the core AI capabilities of our platform, reporting directly to our Co-Founder and CTO. You will specialize in architecting sophisticated agentic systems, optimizing retrieval augmented generation (RAG) pipelines, and establishing rigorous evaluation frameworks to ensure the accuracy and reliability of our personalized medicine practices. This role offers the opportunity to solve complex technical challenges at the intersection of AI and healthcare –while helping shape our technical strategy and product direction.
What You’ll Be Working On
- Design and implement robust agentic harnesses for our healthcare-specific agents, enabling them to reliably chain together actions, reasoning, and tool use to assist clinicians with patient analysis and care planning.
- Develop and optimize Retrieval Augmented Generation (RAG) pipelines and other retrieval techniques to ensure highly accurate, context-aware responses based on health records and medical research.
- Establish and maintain rigorous evaluation (Evals) frameworks for model outputs, agent reliability, and overall platform performance, ensuring high fidelity and safety in a clinical setting.
- Drive technical decisions around AI architecture, model selection, and deployment strategies.
- Collaborate with the team on core platform development, ensuring seamless integration of AI components into our full-stack clinical application.
- Provide feedback and ideas to improve specific procedures, tech implementations, and day-to-day operations to the rest of the team.
- Fostering an environment of continuous learning, improvement, and excellence.
Who We’re Looking For
- A Software Engineer with 5+ years of experience, some of which focused on applied machine learning, LLM applications, or agentic systems.
- Proven experience designing and shipping production LLM applications and complex AI agents.
- Deep expertise in developing reliable retrieval techniques (like RAG) and robust agentic architectures/harnesses.
- Proficiency in building and automating AI evaluation pipelines (Evals) to measure agent performance, hallucination rates, and overall response quality.