About this role
Capital One is hiring a Sr. Lead AI Engineer to design and deploy AI-powered products and foundational AI systems. The role focuses on foundation models, LLM inference, and scalable AI infrastructure within the IFX team to deliver real-time, responsible AI capabilities for customers and associates.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, observability)
- Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch)
- Invent state-of-the-art LLM optimization techniques to improve performance, scalability, cost
- Contribute to technical vision and long-term roadmap of foundational AI systems
Technical Overview
Role spans foundation model training, LLM inference, similarity search with VectorDBs, and governance with observability. Stack includes AWS Ultraclusters, Huggingface, PyTorch; languages include Python, Go, Scala, Java; emphasis on optimizing training and inference for latency and cost in production.
Ideal Candidate
The ideal candidate is a senior AI/ML engineer with deep experience building production AI systems, focusing on foundation models, LLM inference, and scalable ML infrastructure. They should lead cross-functional teams and stay current with AI research to apply in production.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 6 years of experience developing AI and ML algorithms or technologiesor a Master's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 6 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholdersExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systemsand judiciously apply novel techniques in productionExcellent communication and presentation skillswith the ability to articulate complex AI concepts to peers
Tools & Platforms
AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchAWSAmazon Web Services
Required Skills
foundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityHuggingfaceVectorDBsNemo GuardrailsPyTorchAWS UltraclustersAWSAmazon Web ServicesPythonGoScalaJavaLLM optimizationMemorycross-functionalleadership
Hard Skills
AWS UltraclustersAmazon Web ServicesHuggingfaceVectorDBsNemo GuardrailsPyTorchfoundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityPythonGoScalaJavaLLM optimizationMemorycross-functionalleadership
Soft Skills
excellent communication and presentation skillsability to articulate complex AI conceptsteam-orientedproblem-solvingadaptabilityanalytical thinkingleadershipmentoring
Keywords for Your Resume
Sr. Lead AI EngineerCapital Onefoundation model trainingllm inferenceguardrailsobservabilitygovernanceHuggingfaceVectorDBsNemo GuardrailsPyTorchAWS UltraclustersAWSAmazon Web ServicesPythonGoScalaJavaLLM optimizationMemorycross-functionalleadershipproduction AI systemscloud platformshuggingfacepytorchpythonawsamazon web servicesllm optimization
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile