✦ Luna Orbit — AI & Machine Learning

AI Testing Engineer Manager

at Crowe LLP

📍 Sarasota, FL, US Remote 💰 $102K – $204K USD / year Posted March 26, 2026
Salary $102K – $204K USD / year
Type Full-Time
Experience mid
Exp. Years Not specified
Education Not specified
Category AI & Machine Learning

This role involves leading testing and validation efforts for enterprise AI and machine learning systems, focusing on safety, bias, robustness, and compliance. The engineer will architect evaluation frameworks and collaborate across teams to ensure AI system quality.

  • Lead AI testing efforts
  • Architect evaluation frameworks
  • Assess model behavior
  • Ensure safety and bias mitigation
  • Collaborate with data science and engineering teams

The technical environment includes AI and machine learning models, automated testing frameworks, and evaluation datasets. The role requires expertise in Python and AI validation tools.

The ideal candidate is a senior AI Testing Engineer with extensive experience in validating and evaluating enterprise AI and machine learning systems. They possess strong leadership skills, expertise in automated testing frameworks, and a focus on safety, bias, and robustness in AI models.

AI TestingMachine LearningModel ValidationAutomated EvaluationAI Systems
Generative AIBias DetectionModel DriftSafety StandardsAI Security
PythonEvaluation FrameworksData Science Tools
AIArtificial IntelligenceMachine LearningMLGenerative AIModel EvaluationTesting FrameworksValidationBiasRobustnessSafetyModel BehaviorEvaluation DatasetsAI SystemsAutomated Testing
AIArtificial IntelligenceMachine LearningMLGenerative AIModel EvaluationTesting FrameworksValidationBiasRobustnessSafetyModel BehaviorEvaluation DatasetsAI SystemsAutomated Testing
LeadershipCollaborationCommunicationStrategic ThinkingProblem-solvingTeamworkAdaptability
Industry Consulting
Job Function AI testing and validation leadership
Role Subtype QA & Testing
Tech Domains Python
AI TestingMachine LearningModel ValidationAutomated EvaluationAI SystemsGenerative AIBiasRobustnessSafetyEvaluation DatasetsModel BehaviorTesting FrameworksAI SecurityModel DriftAI testingmachine learningmodel validationautomated evaluationgenerative AIbias detectionmodel robustnessAI safetyevaluation datasetsAI systems

Lack of experience in AI validation, No leadership experience in AI testing, No familiarity with AI safety or bias, Unwillingness to work remotely

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile