✦ Luna Orbit — AI & Machine Learning

Sr. Lead AI Engineer ( MLX, Gen AI Platform Services, Agentic AI)

at Capital One Financial

📍 5 Locations Unknown 💰 $229K – $262K USD / year Posted April 03, 2026
Apply Now → ← Browse All Jobs

Position Details

Salary $229K – $262K USD / year
Type Full-Time
Experience lead
Exp. Years 4-6 years
Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
Category AI & Machine Learning

About this role

Lead the design and delivery of AI-powered products and foundational AI systems at Capital One, focusing on foundation models, LLM inference, guardrails, and observability.

Key Responsibilities

  • Partner with cross-functional team to deliver AI-powered products; Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability; Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch; Invent and introduce state-of-the-art LLM optimization techniques to improve performance - scalability, cost, latency, throughput; Contribute to the technical vision and long term roadmap of foundational AI systems at Capital One

Technical Overview

Stack includes Python/Go/Scala/Java, PyTorch, Huggingface, VectorDBs, Nemo Guardrails, AWS Ultraclusters. Focus on foundation model training, LLM optimization, governance, and observability.

Ideal Candidate

The ideal candidate is a senior/lead AI engineer with 6+ years of AI/ML development, strong Python/Java/Scala/Go capability, production ML experience, and cloud deployment familiarity. They should lead cross-functional teams and drive responsible AI guardrails in production.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fieldsAt least 6 years of experience developing AI and ML algorithms or technologiesAt least 6 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholdersExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costExcellent communication and presentation skills

Tools & Platforms

AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorch

Required Skills

PythonJavaScalaGoPyTorchHuggingfaceVectorDBsNemo Guardrailsfoundation model traininglarge language model inferenceguardrailsmodel evaluationexperimentationgovernanceobservabilityAWS UltraclustersOpen Source AI

Hard Skills

PythonGoScalaJavaPyTorchHuggingfaceVectorDBsNemo Guardrailsfoundation model traininglarge language model inferenceguardrailsmodel evaluationexperimentationgovernanceobservability

Soft Skills

communicationleadershipmentoringcross-functional collaborationproblem-solvingclear articulation

Industry & Role

Industry Banking
Job Function Lead the design, development, and deployment of foundational AI systems and LLM-based solutions at Capital One.
Role Subtype AI Engineer
Tech Domains Python, Java, Scala, Go, PyTorch, Huggingface, VectorDBs, Amazon Web Services, Linux, Observability

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

Sr. Lead AI EngineerAIMachine Learningfoundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityHuggingfacePyTorchVectorDBsNemo GuardrailsAWS UltraclustersPythonGoScalaJava

Deal Breakers

Less than 4 years of experience programming in Python/Go/Scala/Java, No experience with production ML or cloud deployments, Unwillingness to work in listed Capital One locations

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile