Position Details

Type Not Specified

Experience mid

Exp. Years Not specified

Education Not specified

Category AI & Machine Learning

About this role

Harvey is seeking a Software Engineer to develop foundational AI platform components that support legal AI products. The role involves building systems for model routing, context management, and evaluation to enable high-quality AI services.

Key Responsibilities

Design and build abstractions and platform-level systems
Own infrastructure for model integration, routing, and evaluation
Build evaluation frameworks and tooling
Partner with product engineering teams
Improve AI quality systematically

Technical Overview

The role involves working with AI models, SDKs, evaluation frameworks, and enterprise-grade AI infrastructure, focusing on scalable, reliable, and accurate AI platform development.

Ideal Candidate

The ideal candidate is an experienced AI engineer with a strong background in building scalable AI platform components, including model routing, evaluation, and infrastructure. They should have experience working on enterprise AI solutions, preferably in legal or domain-specific contexts, and be comfortable working in ambiguous, fast-paced environments.

Must-Have Skills

Build abstractions and platform-level systemsModel routingEvaluation frameworksPartner with product engineering teams

Nice-to-Have Skills

Deep domain expertise in legal AIExperience with enterprise AI platformsKnowledge of large language models

Tools & Platforms

AI modelsSDKsEvaluation frameworks

Required Skills

AIArtificial IntelligenceModel RoutingAgent InfrastructureContext ManagementEvaluation InfrastructureSDKsPlatform PrimitivesDeep LearningModel Integration

Hard Skills

AIArtificial IntelligenceModel RoutingAgent InfrastructureContext ManagementEvaluation InfrastructureSDKsPlatform PrimitivesDeep LearningModel Integration

Soft Skills

OwnershipAmbiguity ToleranceCollaborationProblem-solvingAttention to detail

Industry & Role

Industry SaaS / Legal Tech

Job Function Developing AI platform infrastructure for legal AI applications

Keywords for Your Resume

AIArtificial IntelligenceModel RoutingAgent InfrastructureContext ManagementEvaluation InfrastructureSDKsPlatform PrimitivesDeep LearningModel IntegrationBuild abstractionsPartner with product engineering teamsAI PlatformLegal AIEnterprise AIEvaluation Frameworks

Deal Breakers

Lack of experience with AI platform development, No experience with model evaluation or routing, Unfamiliarity with enterprise AI infrastructure

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Software Engineer, AI Platform

Get matched to jobs like this