Position Details

Type Full-Time

Experience senior

Exp. Years 5 - 10 years

Education Not specified

Category Product Management

About this role

Scale AI is seeking an AI Product Manager, Insights to own model evaluation analysis and insight generation. The role requires turning raw result data into a roadmap for model improvement and presenting findings as a coherent narrative to senior stakeholders.

Key Responsibilities

Own the creation of model evaluation from initial hypothesis, data scraping to final publication
Deeply analyze why the model failed on the other 15%
Structure findings into a logical hierarchy and narrative
Bridge between data and the narrative for clients and researchers
Interview senior leaders and push back when insights aren't insightful

Technical Overview

You will analyze model outputs, review raw data sets, and distill insights into a logical hierarchy. The role bridges ML researchers and clients, requiring strong communication, executive presence, and ability to operate across cross-functional teams.

Ideal Candidate

The ideal candidate is a mid- to senior-level product manager with 5-10 years in DS/ML/AI research and analysis, a structured thinker, and strong executive presence. They excel at turning model evaluation results into a clear, data-driven roadmap and can bridge ML researchers with clients through compelling insights.

Must-Have Skills

5 - 10 years of experience in DSMLAI research and analysisStructured ThinkerHigh Tolerance for AmbiguityExecutive PresenceCross Functionality across ML researchers to clients

Nice-to-Have Skills

Experience in Model EvaluationML EngineeringTechnical ResearchExperience designing or curating datasets (RLHFSFT data)

Required Skills

Model evaluationdata scrapingdata analysishypothesis testingdataset designRLHF dataSFT datacross-functional collaborationexecutive presencestructured thinkerML researchdata storytelling

Hard Skills

Model evaluationData scrapingData analysisDataset designRLHF dataSFT dataCross-functional collaborationExecutive presenceStructured thinkerML researchData storytelling

Soft Skills

Executive PresenceStructured ThinkerStrong communicationCross Functional collaborationQuestioning insightsInterviews with senior leaders

Industry & Role

Industry SaaS

Job Function Product management for insights and model evaluation in AI systems

Role Subtype Product Manager

Keywords for Your Resume

ai product managermodel evaluationdata analysisdataset designrlhf datasft datacross-functionalexecutive presencestructured thinkerml researchdata storytellingsenior leadersdata-driven roadmapresearcher collaborationproduct strategyinsightscross-functional collaboration

Deal Breakers

Less than 5 years of DS/ML/AI research experience, No structured thinking or executive presence, Lack of cross-functional collaboration experience

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile