✦ Luna Orbit — Data & Analytics

Engineering Manager, Inference Developer Productivity

at Anthropic

📍 San Francisco, CA | New York City, NY | Seattle, WA Hybrid Posted March 07, 2026
Type Not Specified
Experience mid
Exp. Years Not specified
Education Bachelor's in Computer Science or related field
Category Data & Analytics

Manage and lead the inference developer productivity team at Anthropic, focusing on building tools and infrastructure to enhance AI model deployment and performance.

  • Build and lead a high-performing team
  • Manage accelerator toolchains
  • Develop infrastructure for hardware efficiency
  • Establish productivity metrics
  • Identify and eliminate workflow inefficiencies

Role involves managing toolchains for GPUs, TPUs, and Trainium hardware, developing infrastructure for inference workloads, and optimizing developer workflows.

The ideal candidate is an experienced engineering manager with a strong background in AI infrastructure, specializing in inference systems and workload optimization. They are proficient in SQL, cloud hardware platforms like GPUs and TPUs, and have a passion for improving developer productivity and system performance.

Product management experienceSQL proficiencyData warehousingUnderstanding of workload performanceExperience with GenAI tools
AI-native experienceGenAI toolsInference softwarePerformance observability
SQLGPUTPUTrainiumDevbox environments
SQLData WarehousingPerformance OptimizationGenAIAIMachine LearningInferenceWorkload OptimizationGPUTPUTrainiumDevbox environments
SQLData WarehousingAnalyticsPerformance OptimizationGenAIAIMachine LearningInferenceWorkload Optimization
Customer EmpathyProduct SenseCollaborationProblem-SolvingLeadershipCommunication
Industry SaaS
Job Function Engineering management for AI inference infrastructure and developer productivity
SQLData WarehousingPerformance OptimizationGenAIAIMachine LearningInferenceWorkload OptimizationGPUTPUTrainiumDevbox environmentsProduct ManagementCustomer EmpathyCollaboration

Lack of experience with AI infrastructure or inference systems, No background in product management or developer tools, Inability to work across multiple hardware platforms

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile