Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience mid

Exp. Years 2+ years

Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Category AI & Machine Learning

About this role

Lead AI Engineer focused on Gen AI platform services and Agentic AI, delivering scalable AI systems with guardrails, vector databases, and model governance.

Key Responsibilities

Partner with cross-functional teams to deliver AI-powered products
Design, develop, and support AI software components including LLM inference and training
Leverage Open Source and SaaS AI technologies
Innovate in LLM optimization for production-scale systems
Contribute to technical vision and long-term AI roadmap

Technical Overview

Hands-on AI/ML engineering across foundation models, LLM inference, and production-grade AI services using PyTorch, HuggingFace, and cloud AI infrastructure.

Ideal Candidate

The ideal candidate is a mid-to-senior AI engineer with 2+ years of AI/ML experience and strong Python/Java/Go background, capable of delivering AI services and contributing to AI platform services with guardrails and governance.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 4 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

6 years of experience deploying scalable and responsible AI solutions on cloud platformsExperience designingdevelopingdeliveringand supporting AI servicesExperience developing AI/ML algorithms using PythonC++C#Javaor GolangExperience optimizing training and inference software for hardware utilizationlatencythroughputand costStaying current with AI research and judicious application in production

Required Skills

foundation model trainingllm inferencevectordbsnemo guardrailshuggingfacepytorchaws ultraclusterscapital oneifx

Hard Skills

PythonGoScalaJavaLLM inferenceVectorDBsPyTorchHuggingfaceAWS UltraclustersNemo GuardrailsGuardrailsMemoryObservabilityExperimentationGovernance

Soft Skills

technical leadershipproblem solvingcommunicationcross-functional collaboration

Industry & Role

Industry Banking

Job Function Deliver AI-powered foundation models and production AI services on Capital One's Gen AI platform.

Role Subtype Lead AI Engineer

Tech Domains Python, Go, Scala, Java, C++, Kubernetes, Docker, Amazon Web Services, Google Cloud Platform, Azure, PyTorch, VectorDBs

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

lead ai engineerai engineerml algorithmsllm inferencevectordbsnemo guardrailsguardrailsmemorypytorchhuggingfaceaws ultraclustersfoundation model trainingsciencemodel governanceobservabilityexperimentationpythonjavakubernetescapital oneifx

Deal Breakers

no bachelor's degree in a technical field, less than 2 years of AI/ML experience, no sponsorship eligibility

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead AI Engineer (AI Foundations)

Get matched to jobs like this