Staff Software Engineer - Serverless

Runware is looking for a Staff/Senior Software Engineer to technically lead and build our serverless platform. You will be part of a small team working closely with senior leadership to bring a new product line to market.

Runware is evolving beyond model APIs into a platform where developers can deploy models and run AI workloads without managing GPUs, servers, or infrastructure. You will build the software layer that connects our proprietary high-performance sonic inference engine and turns complex infrastructure into a compelling developer experience.

What You'll Do

• Build core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation, and scaling leveraging our inference engine.
• Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues, or infrastructure through a clean SDK interface.
• Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries, and failure handling.
• Work closely with infrastructure and ML teams to improve workload startup time, GPU utilization, model warm-up, caching, and placement.
• Build observability that makes serverless workloads easy to monitor, debug, and operate at scale globally.
• Lead technical design, mentor other engineers, and help define engineering standards for a new product area.

Requirements

• Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer, or similar.
• Experience building backend services, distributed systems, developer platforms, or workload orchestration systems.
• Strong understanding of async processing, queues, scheduling, retries, backpressure, and failure handling.
• Comfortable working across APIs, control planes, workers, databases, and observability systems.
• Strong engineering fundamentals in one or more backend languages, ideally Go.
• Sound judgment around trade-offs between reliability, latency, scale, cost, and developer experience.
• Clear communication, strong ownership, and the ability to lead technical direction in a fast-moving environment.

Nice to Have

• Experience building serverless platforms, job execution systems, container platforms, or compute orchestration systems.
• Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing, or high-performance compute.
• Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad, or Knative.
• Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing, or queue management.
• Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting, or usage-based billing.

Benefits

• Generous paid time off – vacation, sick days, and public holidays
• Meaningful stock options – share in the upside you create
• Remote-first setup – work from home anywhere within the employment region
• Flexible hours – own your schedule outside of core collaboration blocks
• Family leave – paid maternity, paternity, and caregiver time
• Company retreats – twice-yearly in-person gatherings in inspiring locations