✦ Luna Orbit — AI & Machine Learning

Engineering Manager, Inference

at Anthropic

📍 San Francisco, CA | New York City, NY | Seattle, WA Hybrid Posted March 07, 2026
Type Not Specified
Experience mid
Exp. Years 1+ years
Education Bachelor's degree or equivalent experience
Category AI & Machine Learning

Manage and contribute to the development of large-scale AI inference and training systems, focusing on performance, scalability, and safety.

  • Lead engineering efforts
  • Optimize inference systems
  • Manage team performance
  • Ensure AI safety
  • Collaborate on technical strategy

Work across machine learning frameworks, GPU/accelerator programming, OS internals, and distributed systems to optimize AI model performance and safety.

The ideal candidate is a mid-level engineering manager with at least 1 year of management experience in machine learning or AI systems, with a strong background in distributed systems, transformers, and performance optimization, passionate about AI safety.

1+ years management experiencePerformance systemsDistributed systemsMachine learningAITransformers
GPU programmingML framework internalsOS internalsLarge-scale ML systems
GPUAcceleratorsML frameworks
Machine LearningAITransformersGPU programmingAccelerator programmingML frameworksOS internalsPerformance optimizationDistributed Systems
Machine LearningAITransformersGPU programmingAccelerator programmingML frameworksOS internalsPerformance optimizationDistributed Systems
Relationship buildingLearning agilityTechnical curiosityCommunicationCollaboration
Industry Technology / AI & ML
Job Function Engineering management for AI systems
Machine LearningAITransformersGPU programmingAccelerator programmingML frameworksOS internalsPerformance optimizationDistributed SystemsManagement experienceAI safety

No management experience, Lack of AI/ML background, Inability to work across technical systems

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile