✦ Luna Orbit — AI & Machine Learning

Senior/Staff Machine Learning Engineer, General Agents, Enterprise GenAI

at Scale AI

📍 San Francisco, CA; New York, NY Onsite Posted April 02, 2026
Type Full-Time
Experience lead
Exp. Years 5+ years
Education Not specified
Category AI & Machine Learning

Senior/Staff Machine Learning Engineer on Scale AI's General Agents team designs, builds, and deploys production-ready AI agents that solve enterprise problems from model and system design to evaluation and deployment.

  • Design and implement end-to-end agent systems with LLM reasoning, tool use, memory, and control logic
  • Build scalable, reliable agent architectures for multi-customer deployments
  • Develop evaluation frameworks, datasets, environments, and metrics
  • Collaborate with product managers, customers, and engineering teams
  • Productionize frontier agent techniques with monitoring and continuous improvement

Production-grade agent systems combining LLM reasoning, tool use, memory, and control logic; engineering toward observable, maintainable, and scalable agent architectures.

The ideal candidate is a senior/lead ML engineer with hands-on production experience building agentic AI systems, strong LLM, prompt engineering, and RAG capabilities, and the communication skills to work with customers and stakeholders.

5+ years of experience building and deploying machine learning or AI systemsProficiency in Python including production-quality codeExperience building systems that integrate models with external toolsAPIsdatabasesand services
Hands-on experience building AI agents using modern generative AI stacksagent frameworksorchestration layersmonitoring/observability for LLM-powered systemsdeployment at scaleLoRA/SFT/RLHF/RLVR
OpenAI APIscommercial or open-source LLMscloud environmentstool callingplannersmulti-agent setupsLoRASFTRLHFRLVR
5+ years of experience building and deploying machine learning or AI systemsstrong knowledge of LLMsprompt engineeringretrieval augmented generationagent orchestrationplanningtool integrationmemoryproduction deploymentevaluation frameworksdatasetsenvironmentsmetricsOpenAI APIsllm stacksplannersmulti-agent setupsRLHFRLVRLoRA
PythonC++Javascripting languagesLLMsprompt engineeringretrieval augmented generationRAGagent orchestrationtool integrationcloud environmentsDockerKubernetes
communicationcustomer-facingcross-functional collaborationpresentation
Industry Technology
Job Function Design, build, and deploy production-ready AI agents for Scale AI's General Agents team
Role Subtype ML Engineer
Tech Domains Python, C++, Java, LLMs, OpenAI APIs, Docker, Kubernetes, Cloud Platforms, Data pipelines, data governance
senior machine learning engineergeneral agentsenterprise genaillmprompt engineeringretrieval augmented generationragagent orchestrationplanningtool usememorycontrol logicproduction deploymentevaluation frameworksdatasetsenvironmentsmetricsopenai apisllm stacksplannersmulti-agent setupsrlhfrlvrloramulti-agent
Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile