About this role
Associate Manager, AI-Enabled Audit & Grading Effectiveness leads AI-driven grading audit initiatives, including prompt engineering and human-in-the-loop validation, to improve grading quality and academic integrity in an education setting.
Key Responsibilities
- Define and own grading audit framework
- Architect AI-powered workflows
- Establish human-in-the-loop standards
- Monitor AI performance metrics
- Partner with technical teams
Technical Overview
Develop AI-powered grading workflows, design evaluation rubrics, monitor AI performance (precision, bias, drift), and coordinate cross-functional collaboration to ensure data-informed decisions in education.
Ideal Candidate
The ideal candidate is an experienced AI/ML leader with a strong background in education, who can design AI-driven grading audit systems, implement human-in-the-loop processes, and translate analytics into actionable improvements.
Must-Have Skills
Minimum 4 years of combined experience across audit/quality operations and applied AI workflow designHands-on experience applying generative AI tools (e.g.ChatGPT) to design or enhance operational workflowsincluding prompt engineeringstructured evaluation frameworksand human-in-the-loop validation processesExperience designing or scaling quality control or audit systemsData analytics experience including performance measurement and trend analysisExperience in academic grading or education environments2+ years of leadership or people management experience
Nice-to-Have Skills
Hands-on experience with generative AI platforms (e.g.ChatGPT or similar)Experience designing AI-driven grading and audit systemsKnowledge of education assessment and integrity practices
Tools & Platforms
ChatGPTGenerative AI platformsPrompt engineeringAgent workflowsStructured rubric ingestionHuman-in-the-loop validationData dashboardsData analytics
Required Skills
Artificial IntelligenceMachine LearningData AnalyticsNatural Language ProcessingPythonSQLPower BIprompt engineeringhuman-in-the-loopstructured data ingestion
Hard Skills
Artificial IntelligenceMachine LearningData AnalyticsNatural Language ProcessingPythonSQLPower BI
Soft Skills
LeadershipStrategic thinkingCommunicationStakeholder managementProblem solving
Keywords for Your Resume
associate manager ai-enabled audit & grading effectivenessai-enabled auditgrading effectivenessprompt engineeringhuman in the loopai audit infrastructuregenerative aichatgptagent workflowsstructured rubric ingestioncalibration loopsdrift detectionai reliabilityeducationacademic integritygradingauditsdata analyticsleadershipremote
Deal Breakers
Lack of experience with generative AI platforms, No experience in education environments, Inability to work remotely, No leadership experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile