Senior Systems Engineer, AI Gateway - Cloudflare

About the Role

AI inference is becoming core infrastructure. AI Gateway is Cloudflare’s edge-based solution for reliability, observability, security, and routing for AI applications. We are looking for a Senior Systems Engineer to build this layer, moving from product concepts to production-ready systems.

This is a hands-on role working across the stack—from distributed systems and high-throughput APIs to SDKs and developer workflows. You will help define how developers build and operate AI applications on Cloudflare.

Responsibilities

• Build core AI Gateway systems handling high-volume inference traffic across the global network.
• Design and implement APIs, routing primitives, and observability features.
• Collaborate with Workers AI and the Developer Platform team to create a coherent product experience.
• Turn ambiguous technical ideas into prototypes, design docs, and shipped features.
• Improve reliability, performance, and cost efficiency for latency-sensitive workloads.
• Build internal tools, agents, and test harnesses to improve engineering velocity.
• Mentor engineers through design and code reviews.

Desirable Skills & Experience

• 5+ years of experience in AI infrastructure, developer platforms, cloud infrastructure, or distributed systems.
• Strong systems engineering fundamentals: networking, APIs, reliability, and data modeling.
• Experience scaling distributed systems where latency, throughput, and availability are critical.
• Ability to work across the stack, from API design to backend services and control planes.
• Strong developer tools taste; experience building SDKs, CLIs, or dashboards.
• Clear technical communication and ability to align teams around architectural tradeoffs.
• Comfort with AI-native development workflows and automation.

Bonus Points

• Experience with model gateways, LLM-powered applications, or provider abstraction layers.
• Hands-on experience with proxy, edge, or traffic management systems.
• Proficiency in TypeScript, Go, or Rust.
• A track record of writing publicly about developer tools or infrastructure.