Position Details
About this role
Sr. SDET at Dialpad focused on building automated testing for AI Voice Agent services; leads end-to-end QA across UI, backend, APIs, and audio/text interactions; develops evals and integrates QA into CI/CD.
Key Responsibilities
- Own end-to-end quality for agentic features
- Design and build automation tooling and frameworks for AI/LLM-driven systems
- Develop and maintain evaluation frameworks (evals) to measure response quality
- Drive automation coverage 80%+ for critical AI workflows
- Integrate AI quality checks into CI/CD pipelines
- Build tooling for LLM observability and debugging
Technical Overview
Scope includes automation tooling, evals for AI outputs, and LLM-driven QA with observability and prompt tracing; will collaborate with Applied AI teams on prompt engineering and model evaluation; expects hands-on automation experience.
Ideal Candidate
The ideal candidate is a senior SDET with strong experience in building end-to-end automated testing for AI/LLM-driven platforms, comfortable with prompt engineering and evals, and capable of integrating QA into CI/CD.
Must-Have Skills
None listed
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile