About this role
Lead AI engineer focused on building Capital One's AI foundation and platform services, including LLMs, guardrails, and observability at scale.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, deploy, and support AI components
- Leverage Open Source and SaaS AI technologies
- Invent and apply LLM optimization techniques
- Contribute to long-term foundation AI systems roadmap
Technical Overview
Stack includes Foundation Model training, LLM inference, PyTorch, HuggingFace, VectorDBs, Nemo Guardrails, AWS Ultraclusters; emphasis on optimization and governance.
Ideal Candidate
The ideal candidate is a senior AI engineer with deep expertise in foundation models, LLM optimization, and scalable AI infrastructure, able to mentor teams and drive production-grade AI platforms.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fieldsAt least 8 years of experience developing AI and ML algorithms or technologiesAt least 8 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP levelExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systemsand judiciously apply novel techniques in productionExcellent communication and presentation skillswith the ability to articulate complex AI concepts to peers
Tools & Platforms
AWS UltraclustersAmazon Web ServicesHugging FaceVectorDBsNemo GuardrailsPyTorch
Required Skills
foundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityAWS UltraclustersAmazon Web ServicesHugging FaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJava
Hard Skills
PythonGoScalaJavaPyTorchHugging FaceAWS UltraclustersAmazon Web Services UltraclustersVectorDBsNemo GuardrailsFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluationExperimentationGovernanceObservability
Soft Skills
Strong collaborationExcellent communicationProblem solvingAdaptabilityMentoring/leadershipTechnical communication
Keywords for Your Resume
Distinguished AI EngineerAIMachine Learningfoundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityOpen SourceHuggingfaceVectorDBsNemo GuardrailsPyTorchPythonGoScalaJavaAWS UltraclustersAmazon Web Services UltraclustersFoundation modelLLM optimizationHugging Face
Deal Breakers
Less than 8 years AI/ML experience with Bachelor's, Less than 6 years AI/ML experience with Master's, No experience with Python/Java/Scala/Go, No experience with PyTorch or Hugging Face, No cloud experience (AWS/Azure/GCP)
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile