AI Architect (Applied LLM Systems) - 22224

Somewhere

Remote
AI Architect (Applied LLM Systems)

Location & Employment Details

  • Location: Remote
  • Schedule: Full-time. Core hours align with India Standard Time, where our engineering team works, plus a regular overlap window with U.S. Pacific time for leadership syncs.
  • Reports to: Co-Founder & CTO
  • Works with: Our engineering team in India, including engineers already building AI features into the platform

About The Company

We are a rapidly growing U.S.-based healthcare technology company building clinical documentation and billing software for community pharmacies. Our platform helps independent pharmacies deliver and get paid for clinical services such as medication therapy management, vaccinations, and pharmacist consultations, and serves insurers with outcomes and analytics tools.

We've grown quickly this year and plan to keep scaling in 2027. AI is now central to our product roadmap.

About The Role

We've already started building AI into our platform. Our engineers are self-taught in AI and have shipped real work, including an internal AI knowledge base built on our own company knowledge. They've done well. What we're missing is someone who has taken AI from idea to production at a company before and knows what good looks like.

That's this role. You'll bring the rigor: the frameworks, guidelines, and best practices that let our team build AI correctly and keep up as the technology changes. You'll find where AI can create the most value across products we sell to existing customers, and guide the team in building it.

We bring deep healthcare and pharmacy domain expertise. You bring the AI expertise. The job is combining the two into products that work in a regulated industry.

Key Responsibilities

AI Strategy & Opportunity

  • Assess where AI can create the most value across our platform and products, and prioritize opportunities with the CTO
  • Keep the team current on fast-moving models, tools, and techniques, and decide which are worth adopting and which aren't
  • Translate our domain experts' needs into practical AI approaches, and explain tradeoffs in plain terms

Architecture, Frameworks & Standards

  • Design the architecture for AI features across the product, including retrieval, agents and tool use, model selection, and integration with our AWS environment
  • Set the frameworks and engineering guidelines the team builds against: patterns, reusable components, prompt and model management, and documentation
  • Review and strengthen what we've already built, including our internal AI knowledge base
  • Choose the simplest approach that works, using existing models and APIs before custom training

Production Quality & Evaluation

  • Take AI features from prototype to reliable production
  • Define evaluation and testing practices to measure accuracy and catch regressions
  • Monitor performance, cost, and latency once features are live, and improve them over time

Data, Security & Compliance

  • Make sure data pipelines feeding AI features are clean, well-structured, and dependable
  • Design AI systems for HIPAA requirements, including de-identification, access controls, and appropriate vendor agreements with model providers
  • Set clear rules for what data can and can't go to which models and services

Team Enablement

  • Guide and mentor the engineering team through design reviews, code reviews, and pairing
  • Build reference implementations the team can extend
  • Raise the team's overall AI skill level through hands-on coaching and shared standards

Required Qualifications

  • 5+ years in software or data engineering, including 2+ years building LLM-based features that shipped to production in a real product, not only prototypes
  • Hands-on experience designing AI systems such as retrieval (RAG), agents and tool use, and evaluation
  • Strong data engineering fundamentals: building clean, reliable pipelines from messy source data
  • Experience with major LLM providers and deploying AI on a major cloud platform (AWS preferred)
  • A portfolio of AI work you can share and walk us through, whether professional, open-source, or side projects
  • Experience setting technical direction or standards that other engineers followed
  • Excellent written and spoken English, with the ability to explain technical tradeoffs to non-specialists
  • Available to work India Standard Time core hours with a regular overlap window with U.S. Pacific time

Preferred Qualifications

  • Healthcare industry experience, especially with clinical, pharmacy, or billing data
  • Experience building AI on sensitive data under HIPAA or similar regulations, including de-identification and vendor agreements
  • Experience with AWS AI services
  • Experience at a SaaS startup or high-growth company
  • Experience mentoring engineers or leading a small technical team

Ideal Candidate Profile

You Are

  • A builder who has shipped. You can point to AI features you've put in front of real users, and explain what broke along the way and how you fixed it.
  • Pragmatic. You reach for the simplest approach that works and can explain why it beats the flashier option.
  • A multiplier. You make a capable team better through standards, reviews, and coaching, not by doing all the work yourself.
  • Security-minded. You think about where data goes before you write the first line of code.
  • Curious and current. You keep up with a fast-moving field and can tell real progress from hype.
  • A clear communicator. You can talk architecture with engineers and business value with founders, often in the same meeting.

Why Join Us

  • Shape the AI direction. You'll set the AI frameworks and standards for a fast-growing company, working directly with the CTO.
  • A team ready to build. Our engineers are already shipping AI. You'll make them faster and more rigorous rather than starting from zero.
  • Real-world impact. Your work goes into products pharmacies and insurers use to improve patient care.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.