✦ Luna Orbit — QA & Testing

Sr. SDET

at Dialpad

📍 Vancouver, Canada Onsite Posted April 09, 2026
Type Full-Time
Experience senior
Exp. Years Not specified
Education Not specified
Category QA & Testing

Sr. SDET at Dialpad focused on building automated testing for AI Voice Agent services; leads end-to-end QA across UI, backend, APIs, and audio/text interactions; develops evals and integrates QA into CI/CD.

  • Own end-to-end quality for agentic features
  • Design and build automation tooling and frameworks for AI/LLM-driven systems
  • Develop and maintain evaluation frameworks (evals) to measure response quality
  • Drive automation coverage 80%+ for critical AI workflows
  • Integrate AI quality checks into CI/CD pipelines
  • Build tooling for LLM observability and debugging

Scope includes automation tooling, evals for AI outputs, and LLM-driven QA with observability and prompt tracing; will collaborate with Applied AI teams on prompt engineering and model evaluation; expects hands-on automation experience.

The ideal candidate is a senior SDET with strong experience in building end-to-end automated testing for AI/LLM-driven platforms, comfortable with prompt engineering and evals, and capable of integrating QA into CI/CD.

None listed

Experience with AI/LLM QAExperience with evaluation frameworks for AI modelsHands-on coding in AI/ML QA tooling
CI/CD pipelinesPrompt tracing toolingEvaluation frameworks
SDETtest automationautomation frameworksCI/CDContinuous Integration/Continuous DeploymentAI QALLMprompt engineeringagent orchestrationprompt flowsevalsevaluation frameworksUI testingbackend testingAPI testingobservabilityprompt tracingDialpadend-to-end testing
Test automationAutomation toolingCI/CDContinuous Integration/Continuous DeploymentAI QALLMprompt engineeringagent orchestrationprompt flowsevalsevaluation frameworksUI testingBackend testingAPIs testingobservabilityprompt tracingend-to-end testing
CollaborativeCommunicationTeamworkProblem-solvingAdaptabilityProactive
Industry SaaS
Job Function Lead automated QA for AI-powered agent platforms, shaping testing strategy and infrastructure
Role Subtype Senior SDET
Sr. SDETSDETQAtest automationautomation toolingCI/CDContinuous Integration/Continuous DeploymentAI QALLMprompt engineeringagent orchestrationprompt flowsevalsevaluation frameworksfrontend testingbackend testingapis testingobservabilityprompt tracingAI Voice Agentagentic QADialpadvancouveronsitesaasQA automationend-to-end testingAPIs testing
Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile