✦ Luna Orbit — AI & Machine Learning

Sr. Lead AI Engineer

at Klaviyo

📍 Palo Alto, CA Onsite Posted March 18, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Full-Time
Experience lead
Exp. Years Not specified
Education Not specified
Category AI & Machine Learning

About this role

Klaviyo is seeking a senior AI engineer to lead the development of scalable, reliable AI backend systems. The role involves architecture design, collaboration with data science teams, and ensuring high performance for AI-driven products.

Key Responsibilities

  • Define and improve AI architecture
  • Lead backend system design
  • Build AI serving systems
  • Evolve agent architecture
  • Collaborate with product and data science teams

Technical Overview

The role focuses on building and maintaining distributed backend systems for AI services, including LLM hosting, API development, and system observability, primarily using Kubernetes, Python, and cloud infrastructure.

Ideal Candidate

The ideal candidate is a senior AI engineer with extensive experience in designing and implementing scalable, low-latency AI backend systems. They should have strong expertise in machine learning, distributed systems, and API development, with a proven track record of leading technical projects in SaaS environments.

Must-Have Skills

Experience with AI service architectureBackend systems developmentDistributed backend systemsAPIs for AI productsExperience with LLMs

Nice-to-Have Skills

Experience with low-latency systemsScalable system designData science collaborationProduct development experienceObservability tools

Tools & Platforms

KubernetesDockerAPIsMonitoring tools

Required Skills

AI EngineerMachine LearningLLMsDistributed SystemsAPIsKubernetesPythonObservabilityRetrieval SystemsAI service architecture

Hard Skills

PythonKubernetesK8sMachine LearningAILLMsAPIsDistributed SystemsObservabilityRetrieval SystemsTools and Evaluators

Soft Skills

LeadershipCommunicationCollaborationProblem-solvingDesign Thinking

Industry & Role

Industry SaaS
Job Function Lead the design and implementation of scalable AI backend systems
Role Subtype AI Engineer
Tech Domains Python, Kubernetes, AI, Machine Learning, Distributed Systems

Keywords for Your Resume

AI EngineerMachine LearningLLMsDistributed SystemsAPIsKubernetesK8sPythonObservabilityRetrieval SystemsAI service architectureScalable backend systemsLow-latency systemsAI & AnalyticsSaaSAI engineermachine learninglarge language modelsdistributed systemsscalable systemslow latencyobservability

Deal Breakers

Lack of experience with AI service architecture, No backend systems development experience, No experience with distributed systems, No knowledge of Kubernetes or containerization, Unwillingness to work onsite in Palo Alto

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile