Position Details

Salary $30 – $45 USD / year

Type Not Specified

Experience mid

Exp. Years 0+ years

Education Not specified

Category QA & Testing

About this role

This role involves testing AI-powered journaling tools, evaluating LLM outputs, and transitioning testing workflows from manual to automated processes to ensure reliability and quality.

Key Responsibilities

Design test plans
Evaluate AI workflows
Perform regression testing
Collaborate with engineers
Automate testing processes

Technical Overview

The position requires experience with QA methodologies, AI evaluation, regression testing, and automation tools like Postman and Sentry, within a remote environment.

Ideal Candidate

The ideal candidate is a detail-oriented QA engineer with experience in testing AI-powered applications, capable of designing comprehensive test plans for mobile and web interfaces, and familiar with AI evaluation tools like Postman and Sentry.

Must-Have Skills

Designexecuteand maintain test plans for mobile and webEvaluate AI workflows and LLM outputsPerform regression testing before deploymentsCollaborate with engineers to reproduce bugsHelp transition from manual to automated testing

Nice-to-Have Skills

Experience with PostmanSentryExperience with automated testing frameworksUnderstanding of AI and LLMs

Tools & Platforms

PostmanSentryAutomated testing frameworks

Required Skills

QAQuality AssuranceTest PlansMobile TestingWeb TestingAI EvaluationLLMRegression TestingAutomationPostmanSentryAutomated Testing FrameworksAI promptsTesting lifecycle

Hard Skills

QAQuality AssuranceTest PlansMobile TestingWeb TestingAI EvaluationLLMRegression TestingAutomationPostmanSentryAutomated Testing FrameworksAI promptsTesting lifecycle

Soft Skills

Attention to detailAnalytical thinkingCommunicationProblem-solvingEmpathy

Industry & Role

Industry Technology

Job Function Quality assurance and testing for AI-driven applications

Keywords for Your Resume

QA EngineerQuality AssuranceTest PlansMobile TestingWeb TestingAI EvaluationLLMRegression TestingAutomationPostmanSentryAutomated Testing FrameworksAI promptsTesting lifecycle

Deal Breakers

Lack of experience with AI or LLM testing, No experience with automated testing tools, Inability to work remotely, Less than 1 year of relevant experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile