✦ Luna Orbit — AI & Machine Learning

QA Software Test Engineer Code Review - Remote

at YO IT CONSULTING

📍 Remote, US Remote Posted April 10, 2026
Apply Now → ← Browse All Jobs

Position Details

Type Freelance
Experience mid
Exp. Years 2+ years
Education Bachelor’s minimum in Software Engineering, Computer Science, or a related field
Category AI & Machine Learning

About this role

YO IT CONSULTING is seeking experienced software engineers to help build evaluation datasets for AI labs. The work involves creating realistic developer prompts and writing technically accurate model responses focused on reasoning and explanation quality in coding-related interactions.

Key Responsibilities

  • Craft realistic developer prompts for coding interactions
  • Source and adapt content from real PRs
  • Write technically accurate model responses with strong reasoning
  • Focus on AI reasoning, explanation quality, and technical judgment
  • Assist with building evaluation datasets for AI labs

Technical Overview

You will craft prompts across code review, debugging, error diagnosis, and configuration, using content sourced from real PRs. You will write clear model responses demonstrating strong reasoning and explanation quality, rather than executable correctness.

Ideal Candidate

The ideal candidate is a software engineer with 2+ years of experience in software engineering, technical research, or educational content development. They have strong proficiency in Python, JavaScript, Java, or C++, and experience with debugging, testing, and validating code, along with comfort producing high-quality technical writing and realistic code-related prompts.

Must-Have Skills

Strong proficiency in languages like PythonJavaScriptJavaor C++Experience with debuggingtestingand validating codeComfortable with technical writing and attention to detail2+ years of experience in software engineeringtechnical researchor educational content developmentCraft realistic developer prompts across multiple categories (code reviewdebuggingerror diagnosisconfigurationand more)

Required Skills

PythonJavaScriptJavaC++software engineeringcode reviewdebuggingtestingvalidating codetechnical writingattention to detailevaluation datasetsAI reasoningexplanation qualitytechnical judgment

Hard Skills

PythonJavaScriptJavaC++Software engineeringDebuggingTestingValidating codeTechnical writingCode reviewError diagnosisConfigurationContent development

Soft Skills

Attention to detailTechnically accurate explanation qualityReasoning and explanation clarityTechnical communicationAbility to craft realistic prompts

Industry & Role

Industry Science & Research
Job Function Develop code-related evaluation prompts and responses to assess AI reasoning and explanation quality.
Role Subtype SDET
Tech Domains Python, Java, JavaScript, AI & Machine Learning, Data & Analytics

Keywords for Your Resume

QASoftware Test Engineertest engineerSoftware Engineeringcode reviewdebuggingerror diagnosisconfigurationPythonJavaScriptJavaC++testingvalidating codetechnical writingattention to detailevaluation datasetsAI reasoningexplanation qualitytechnical judgmentcoding-related interactionschat-pasteable promptsindependent contractorfreelancerspart-time15-25 hours/week

Deal Breakers

Must have 2+ years of experience in software engineering, technical research, or educational content development, Must have strong proficiency in Python, JavaScript, Java, or C++, Must have experience with debugging, testing, and validating code

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile