Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience lead

Exp. Years 2+ years

Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields OR Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms or technologies

Category AI & Machine Learning

About this role

Lead AI Engineer responsible for designing and deploying AI foundations and LLM-based services, including model training, inference, and governance across Capital One's AI platforms.

Key Responsibilities

Partner with cross-functional teams to deliver AI-powered products
Design, develop, test, deploy, and support AI components including foundation model training and LLM inference
Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs)
Innovate LLM optimization techniques for performance and cost
Contribute to the technical vision and long-term roadmap

Technical Overview

Hands-on development with Python/ML languages, cloud platforms (AWS, GCP, Azure), and ML tooling (PyTorch, Huggingface); building production-ready AI services with guardrails, observability, and scalable infrastructure.

Ideal Candidate

The ideal candidate is an experienced AI/ML engineer with 2+ years post-master’s experience or 4+ years post-bachelor in AI/ML and a strong track record deploying LLM-based solutions on cloud platforms, with hands-on experience in PyTorch and Huggingface.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 4 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingdeliveringand supporting AI servicesExperience developing AI and ML algorithms or technologies using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software

Tools & Platforms

AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorch

Required Skills

AI foundationsLLM coreagentic AIfoundation model trainingLLM inferencePythonGoScalaJavaPyTorchHuggingfaceVectorDBsNemo GuardrailsAWS UltraclustersAmazon Web ServicesGoogle Cloud PlatformAzureKubernetesDockerCI/CDobservabilityOpenTelemetry

Hard Skills

PythonGoScalaJavaPyTorchHuggingfaceOpen Source AI technologiesLLM inferenceSimilarity searchVectorDBsNemo GuardrailsAWS UltraclustersAmazon Web ServicesCloud platformsAWSGoogle CloudAzure

Soft Skills

CreativityCommunicationCollaborationAdaptabilityProblem-solving

Industry & Role

Industry Fintech

Job Function Design, develop, and deploy AI foundation models and agentic AI components at Capital One.

Role Subtype AI Engineer

Tech Domains Python, Amazon Web Services, Google Cloud Platform, Azure, Kubernetes, Docker

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

Lead AI EngineerAI FoundationsLLM CoreAgentic AIfoundation model trainingLLM inferencesimilarity searchVectorDBsNemo GuardrailsPyTorchHuggingfaceOpen Source AI technologiesLLM optimizationAWSAmazon Web ServicesGoogle CloudAzurePythonGoScalaJavaCI/CDDockerKubernetesObservabilityOpenTelemetryAI servicesFoundation model trainingAWS Ultraclusters

Deal Breakers

No degree in CS/AI or related field, No cloud experience, Lack of hands-on experience with Python/ML frameworks

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Get matched to jobs like this