Software Engineer, AI Gateway - Vercel

About Vercel

Vercel is the agentic infrastructure company. We free people and agents to ship what’s next. For more than a decade, Vercel has shaped how the web is built. As the team behind Next.js, v0, and AI SDK, we create products that help builders move from idea to production with speed, security, and exceptional developer experience.

About the Role

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations.

What You Will Do

• Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing unified API endpoints, rate limit management, and intelligent failover mechanisms.
• Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
• Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models.
• Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
• Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and usage insights.

About You

• 5+ years of relevant experience.
• Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure.
• Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers).
• Experience contributing to or participating in open source projects.
• Excellent communication skills and the ability to work effectively in a collaborative team environment.

Benefits

• Competitive compensation package, including equity.
• Inclusive Healthcare Package.
• Mentorship and professional development opportunities.
• Flexible Time Off.
• Equipment provided and a WFH budget to outfit your space.