About this role
Lead the Evaluations & Optimization team in AWS Agentic AI, building scalable systems and developer tooling that help customers evaluate and optimize autonomous AI agents. You will grow a team of engineers while ensuring operational excellence and timely execution of key automation goals and customer launches.
Key Responsibilities
- Hire, motivate, mentor, and grow engineering talent
- Collaborate with cross-functional product and engineering teams to deliver features
- Execute organizational automation goals and customer launches by removing blockers
- Provide input on OP1 and roadmap discussions with leadership
- Architect and develop technical designs while building operational excellence
Technical Overview
This role focuses on foundational infrastructure for evaluation workflows for GenAI and agentic systems, spanning deep learning, large-scale distributed systems, and evaluation science workflows. It also requires strong software engineering lifecycle ownership (coding standards, code reviews, source control management, build, testing, certification, and livesite operations) to run critical services reliably.
Ideal Candidate
The ideal candidate is a Software Development Manager with strong engineering leadership experience (3+ years managing teams) and deep hands-on experience building and operating multi tier web services. They are comfortable working across distributed systems and GenAI/agentic evaluation workflows, with a proven ability to build developer tooling and operational excellence while collaborating with applied scientists and product teams.
Must-Have Skills
engineering team managementengineering experienceleading the definition and development of multi tier web services experienceknowledge of engineering practices and patterns for the full software/hardware/networks development life cyclecoding standardscode reviewssource control managementbuild processestestingcertificationlivesite operationspartnering with product or program management teams
Nice-to-Have Skills
evaluation workflows for GenAI and agentic systemsagent optimizationarchitecting agentic evaluation and optimization infrastructurecommunicating technical decisions to non-technical audiences
Tools & Platforms
Amazon Web Services (AWS)
Required Skills
engineering team managementGenAI systemsautonomous agentsevaluation workflowsagentic systemsagents optimizationdeep learninglarge-scale distributed systemsevaluation science workflowsinfrastructuredeveloper toolingoperational excellenceautomation goalsOP1multi tier web servicescoding standardscode reviewssource control managementbuild processestestingcertificationlivesite operationspartner with product or program management teams
Hard Skills
engineering team managementGenAI systemsagentic systemsautonomous agentsevaluation workflows for GenAI and agentic systemsdeep learninglarge-scale distributed systemsevaluation science workflowsstate-of-the-art systems designfoundational infrastructuredeveloper toolingoperational excellenceautomation goals executionarchitect and develop technical designs and approachesmulti tier web servicescoding standardscode reviewssource control managementbuild processestestingcertificationlivesite operationspartnering with product or program management teams
Soft Skills
hiremotivatementorand grow teamscross-functional collaborationremove blockers and reduce execution risksprovide input on OP1communicate technical decisions to technical and non-technical audienceslead automation goalscustomer collaboration (enterprise customers and developers)
Keywords for Your Resume
Software Development ManagerAgentic AIAgentCoreEvaluations & Optimization teamEvaluations teamGenAIautonomous agentsevaluation workflowsagentic systemsqualityperformancereliabilityagents optimizationdeep learninglarge-scale distributed systemsevaluation science workflowsinfrastructuredeveloper toolingoperational excellenceautomation goalsOP1multi tier web servicescoding standardscode reviewssource control managementbuild processestestingcertificationlivesite operationsProduct Managementprogram management
Deal Breakers
3+ years of engineering team management experience, 7+ years of engineering experience, 8+ years of leading the definition and development of multi tier web services experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile