Senior Engineering Manager, AI Quality & Governance - Mitratech

At Mitratech, we are a team of innovators focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We serve 20,000 client companies globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.

About the AI Platform Organization

Mitratech’s AI mission is to turn its legal data and products into a unified, safe AI platform that powers the top legal workflows in every core solution and drives meaningful gains in legal team productivity and AI-influenced revenue.

The AI organization owns the platform, standards, and integration patterns that make it possible for product teams to ship safe, impactful AI that improves customer outcomes. The organization is designed using Team Topologies: stream-aligned product teams sit at the top, an AI Platform layer sits in the middle, and Cloud & Data Foundation sits below.

About the Role

This role leads the combined AI Quality & Governance function, initially bringing together Governance & Policy and Evaluations & Observability. You will own the platform that makes AI systems at Mitratech measurable, observable, governable, and production-ready.

This is explicitly a hands-on leadership role. The team begins small — likely one to two direct reports — and you are expected to spend roughly half of your time writing and reviewing production code while the organization scales.

What You Will Do

• Own the AI evaluations and observability platform, including tracing, logs, dashboards, quality signals, and operational feedback loops.
• Design and operationalize automated and human-in-the-loop evaluation strategies for quality, safety, latency, and cost.
• Establish standards that define production-ready AI, including evaluation criteria, release gates, and incident playbooks.
• Build and operate AI guardrails and policy enforcement capabilities such as content controls, PII detection, audit logging, and workflow-level checks.
• Translate emerging governance and risk expectations into working engineering systems and platform controls.
• Own platform-level SLOs and tier-two incident support for AI behavior issues.
• Act as an internal authority on AI quality and governance and participate in customer-facing conversations.
• Hire, mentor, and grow the team over time.

What We Are Looking For

• 8+ years of software engineering experience including meaningful experience leading engineers as a manager or technical lead.
• Hands-on experience building, shipping, or operating production AI systems, ideally including LLM-powered or agentic workflows.
• Strong experience designing and operating production backend systems and APIs.
• Experience with AI observability, evaluation, or debugging systems (e.g., LangSmith, LangFuse).
• Practical experience designing or operating AI guardrails: content filtering, redaction, and access controls.
• Familiarity with AI governance and risk frameworks such as NIST AI RMF or ISO/IEC 42001.
• A strong bias toward hands-on execution, platform thinking, and creating paved roads for other teams.

The Stack Context

• Engineering environment primarily uses Python and TypeScript.
• Platform operates across AWS and OCI.