Senior Machine Learning Engineer - Cloudflare

About the Role

As a Senior Machine Learning Engineer at Cloudflare, you will define how machine learning models run across our global network. From frontier open LLMs and real-time voice models to customer-deployed models on heterogeneous GPUs, you will bridge the gap between applied ML, inference optimization, and production engineering.

Responsibilities

• Productionize ML: Develop and optimize models for our serverless inference platform with a focus on reliability and performance.
• Benchmarking: Build frameworks to measure latency, throughput, cost efficiency, and model behavior across LLMs, speech, vision, and multimodal architectures.
• Inference Optimization: Improve performance through quantization, batching, caching, model compilation, and runtime tuning.
• Infrastructure Collaboration: Partner with systems engineers to integrate models into our distributed inference infrastructure across a fleet of GPUs and next-gen accelerators.
• Workflow Excellence: Drive improvements to deployment workflows, including validation, rollout safety, observability, and operational readiness.
• Mentorship: Contribute to technical direction and raise the quality bar for production ML engineering practices.

Desirable Skills & Experience

• Proven experience building, optimizing, and operating ML models in production.
• Strong proficiency in Python and modern frameworks (PyTorch, TensorFlow, JAX).
• Hands-on experience with inference optimization (quantization, batching, compilation).
• Familiarity with serving frameworks such as vLLM, TensorRT-LLM, ONNX Runtime, Triton, or llama.cpp.
• Deep understanding of modern deep learning architectures (LLMs, speech, vision, RAG).
• Ability to work across ML and systems boundaries (distributed systems, networking).
• Track record of leading complex technical projects and mentoring engineers.

Why Cloudflare?

Cloudflare is on a mission to build a better Internet. We value curiosity over bureaucracy and believe AI is a partner in solving tough problems. We are committed to protecting the free and open Internet through initiatives like Project Galileo, the Athenian Project, and our privacy-first 1.1.1.1 DNS resolver.