✦ Luna Orbit — Software Engineering

Mid/Senior/Staff Software Engineer, Agents

at Harvey

📍 New York Unknown Posted April 09, 2026
Type Full-Time
Experience senior
Exp. Years 3+ years
Education Not specified
Category Software Engineering

Software Engineer, Agents, building AI agent systems for legal professionals, focusing on prompt engineering, agent frameworks, and production-grade tool integration.

  • Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what 'excellent' means, and ship agents that get the job done
  • Optimize agent performance through prompt engineering, model selection, tool design, and eval harness development
  • Work with our model infra team to design and implement infrastructure for low-latency agent execution
  • Improve observability and instrumentation to profile agent behavior and drive optimization decisions
  • Stay current on developments in agentic systems and bring learnings back to products

Python-based agent tooling with LLM APIs; emphasis on low-latency execution, tool orchestration, and observability instrumentation in a legal-tech context.

The ideal candidate is a mid-to-senior software engineer with 3+ years of Python experience and hands-on work with LLM APIs and agent frameworks to ship production-grade AI agents in legal workflows.

3+ years of software engineering experienceProficiency in PythonExperience with LLM APIs and agent frameworksExperience shipping user-facing productsTeam collaboration
PythonLLM APIsagent frameworksprompt engineeringmodel infralow-latency agent executioncachingparallel tool callssubagent patternsevaluation harnessobservabilityinstrumentation
PythonLLM APIsagent frameworksprompt engineeringmodel infralow-latency agent executioncaching strategiesparallel tool callssubagent patternsevaluation harnessobservabilityinstrumentation
AmbitionOwnershipCollaborationAdaptabilityCustomer focus
Industry Legal & Compliance
Job Function Build and optimize AI agent systems for legal workflows, focusing on performance, evaluations, and observability.
Role Subtype Software Engineer, Agents
Tech Domains Python
software engineeragentspythonllmagent frameworksprompt engineeringllm APIslow-latency agent executionevaluation harnessonboardingboard-readyai agentslegal professionalsPythonLLMobservabilityinstrumentationshipping user-facing productsNew York

No experience with Python or LLMs, Cannot ship user-facing products

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile