✦ Luna Orbit — AI & Machine Learning

Sr. Lead AI Engineer (AI Foundations)

at Capital One Financial

📍 4 Locations Unknown 💰 $229K – $262K USD / year Posted April 02, 2026
Apply Now → ← Browse All Jobs

Position Details

Salary $229K – $262K USD / year
Type Full-Time
Experience lead
Exp. Years 4+ years
Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field; or Master's degree in related fields
Category AI & Machine Learning

About this role

Capital One seeks a Sr. Lead AI Engineer to design and deploy AI foundations, including foundation model training and LLM inference, using Open Source and SaaS AI technologies. The role involves cross-functional collaboration and ownership of AI components from development to governance.

Key Responsibilities

  • Partner with cross-functional teams to deliver AI-powered products
  • Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
  • Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch)
  • Invent and introduce LLM optimization techniques to improve performance, scalability, cost, latency, throughput
  • Contribute to the technical vision and long-term roadmap of foundational AI systems

Technical Overview

Stack includes Python, Go, Scala, Java; PyTorch; HuggingFace; AWS Ultraclusters; VectorDBs; Nemo Guardrails; foundation model training; LLM optimization; observability and governance in AI systems.

Ideal Candidate

The ideal candidate is a senior AI engineer with 4+ years of AI/ML experience (or 6+ years with a bachelor's), strong foundation in AI systems, and hands-on expertise with LLMs, PyTorch, HuggingFace, and vector databases. They should be able to design and deploy foundation models, optimize LLM performance, mentor engineers, and contribute to Capital One's AI roadmap across multiple locations.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields with 6+ years experience in AI/ML OR Master's degree with 4+ years in AI/MLAt least 4 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

Experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsExperience leading and mentoring an engineering teamExperience with LLM InferenceSimilarity Search and VectorDBsGuardrailsMemoryExperience optimizing training and inference software for hardware utilizationlatencythroughputand costStrong AI research literacy and ability to apply techniques in productionExcellent communication and presentation skills

Tools & Platforms

AWSAmazon Web ServicesHuggingFacePyTorchNemo GuardrailsVectorDBsAWS Ultraclusters

Required Skills

foundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityPythonGoScalaJavaPyTorchHuggingFaceVectorDBsNemo GuardrailsAWS Ultraclusters

Hard Skills

PythonGoScalaJavaPyTorchHuggingfaceVectorDBsNemo GuardrailsFoundation model trainingLarge Language Model inferenceLLM optimizationGuardrailsmodel evaluationexperimentationgovernanceobservabilityAWS UltraclustersAmazon Web Services

Soft Skills

collaborationcommunicationproblem solvingleadershipmentoringstrategic thinkingadaptabilitydecision makingteamwork

Industry & Role

Industry Fintech
Job Function Lead the development and deployment of foundational AI systems and AI-powered products for Capital One
Role Subtype AI Engineer
Tech Domains Python, Java, Scala, Go, PyTorch, Hugging Face, VectorDBs, Nemo Guardrails, Amazon Web Services, AWS

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

Sr. Lead AI EngineerLead AI EngineerAI Foundationsfoundation model traininglarge language model inferenceSimilarity SearchVectorDBsNemo GuardrailsHuggingfacePyTorchPythonGoScalaJavaAWS UltraclustersAmazon Web ServicesLLM Inferenceobservabilitygovernancemodel evaluationexperimentationguardrailsfoundation modelscloud platforms

Deal Breakers

Bachelor's degree not in a related field and no equivalent experience, Less than 4 years AI/ML production experience (or <6 years with Bachelor's), No experience with Python/Java/Scala/Go

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile