Senior AI Engineer - Osano

About Osano

Osano is an innovative B-Corporation built around a simple belief: privacy is a fundamental right. Since day one, we’ve been focused on giving modern enterprises the ability to innovate quickly, stay competitive, and earn customer trust by respecting data privacy and complying with consent guidelines. Our products help organizations operate confidently in a rapidly evolving regulatory and technological landscape.

Note: This role may require in-person interview(s) in Austin, Texas.

About the Role

We’re looking for a Senior AI Engineer to join our Engineering team. This person will play a pivotal role in architecting and delivering privacy-first AI systems that power the next generation of Osano’s product capabilities.

This role goes beyond wrapping APIs or building chat interfaces. You will design and deploy autonomous AI agents, strict-source-following RAG systems, and evaluation frameworks that ensure reliability, compliance, and production-grade performance.

Responsibilities

AI System Architecture

• Architect and deploy autonomous AI agents and multi-agent workflows.
• Design strict-source-following Retrieval-Augmented Generation (RAG) systems that minimize hallucination and enforce citation integrity.
• Implement guardrails, structured outputs, and validation layers.

Production Engineering

• Build scalable backend services using FastAPI.
• Orchestrate agentic workflows using LangGraph.
• Deploy and manage AI workloads within AWS or Azure.
• Optimize model performance, reliability, and cost.

Evaluation & Continuous Improvement

• Develop rigorous evaluation pipelines measuring accuracy, citation adherence, latency, and reliability.
• Establish metric-driven iteration cycles.
• Continuously refine deployed systems based on measurable outcomes.

Privacy-First Development

• Embed privacy-by-design principles across the AI stack.
• Ensure compliance, data sovereignty, and secure handling practices.
• Collaborate cross-functionally to align AI capabilities with regulatory standards.

Requirements

Must-Haves:

• 5+ years of professional engineering experience.
• Experience deploying and managing AI workloads in AWS or Azure.
• Deep technical understanding of LLM usage and orchestration beyond prompt engineering.
• Strong expertise in the Python AI ecosystem, specifically FastAPI and LangGraph.
• Proven experience building complex RAG systems and autonomous AI agents.
• Experience building evaluation frameworks and iterating based on performance metrics.

Nice-to-Haves:

• Experience with Knowledge Graphs to enhance RAG precision.
• Familiarity with Privacy-Enhancing Technologies (PETs).
• Experience with data anonymization techniques.
• Background in compliance-heavy or regulated environments.

Benefits

• Competitive compensation and ownership interest/equity.
• Unlimited paid time off, plus a requirement to take at least two weeks off per year.
• Paid parental leave for all new parents (Best Place for Working Parents honoree).
• Osano sponsors individual premiums on base plans at 100% and dependent premiums at 50% for Medical, Dental, and Vision insurance via Aetna.
• Fully and permanently remote work environment (anywhere in the U.S.).
• MacBook and $600 home workspace setup stipend.
• Annual company trip designed to foster connection, creativity, and fun.
• Mental health benefits with free memberships to mindfulness and talk therapy services.
• Access to professional training programs and clear career paths.