Position Details
About this role
This role involves designing and maintaining evaluation pipelines for large language models and generative AI systems within Amazon's AGI Data Services team.
Key Responsibilities
- Own LLM evaluation pipelines
- Design GenAI-powered tools
- Collaborate with scientists
- Build backend services on AWS
- Improve data quality assessment
Technical Overview
The technical environment includes AWS cloud services, Python programming, and GenAI tools like LangChain and LangGraph, focusing on AI model assessment and workflow automation.
Ideal Candidate
The ideal candidate is a senior AI engineer with expertise in large language models, generative AI, and cloud platforms like AWS. They should have strong engineering fundamentals and experience designing evaluation pipelines for AI models.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Lack of experience with large language models, No AWS experience, No Python proficiency, No experience with evaluation pipelines
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile