✦ Luna Orbit — Software Engineering

Software Engineer, AI Gateway

at Vercel

📍 Hybrid - San Francisco, New York City Hybrid Posted March 20, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Full-Time
Experience mid
Exp. Years 5+ years
Education Not specified
Category Software Engineering

About this role

This role involves developing and maintaining the AI Gateway platform, focusing on creating reliable, low-latency APIs for AI models from multiple providers. The engineer will work on system design, implementation, and collaboration with cross-functional teams.

Key Responsibilities

  • Design and implement AI Gateway features
  • Write efficient, well-documented code
  • Collaborate with cross-functional teams
  • Enhance system reliability and performance
  • Contribute to open source projects

Technical Overview

The environment includes JavaScript/TypeScript, cloud infrastructure, distributed systems, and AI/ML integrations, with a focus on system reliability, performance, and scalability.

Ideal Candidate

The ideal candidate is a mid-level software engineer with 5+ years of experience in backend development, specializing in APIs, cloud infrastructure, and AI/ML integrations. They are proficient in TypeScript and have a strong understanding of distributed systems and system reliability.

Must-Have Skills

JavaScript/TypeScriptAPIscloud infrastructureAI/ML integrationsdistributed systems

Nice-to-Have Skills

open source contributionsrate limitingfailover mechanismsperformance optimization

Tools & Platforms

OpenAIAnthropicGoogle CloudNext.jsVercel

Required Skills

JavaScriptTypeScriptAPIscloud infrastructurerate limitingfailoverlow-latencyAI/ML integrationsdistributed systemsopen source

Hard Skills

JavaScriptTypeScriptAPIscloud infrastructurerate limitingfailover mechanismslow-latency systemsreliable systemsAI/ML integrationsdistributed systems

Soft Skills

communicationcollaborationproblem-solvingteamworkadaptability

Industry & Role

Industry SaaS
Job Function Developing and maintaining a reliable AI API platform
Role Subtype Backend Engineer
Tech Domains JavaScript, TypeScript, APIs, cloud infrastructure, distributed systems

Keywords for Your Resume

software engineerAI gatewayAPIsTypeScriptcloud infrastructuredistributed systemsrate limitingfailoverlow-latencyAI/ML integrationsopen sourcereliability engineeringperformancescalabilityautomationAI/MLreliability

Deal Breakers

Less than 5 years of relevant experience, Lack of experience with APIs or cloud infrastructure, No proficiency in TypeScript or JavaScript

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile