About this role
Senior Lead AI Engineer steering GenAI platform services, focusing on production-grade AI systems, LLMs, and guardrails across Capital One’s banking platforms.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference
- Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
- Invent LLM optimization techniques
- Contribute to technical vision and roadmap of foundational AI systems
Technical Overview
Technical scope includes Python, Go, Scala, Java; PyTorch; HuggingFace; VectorDBs; Nemo Guardrails; AWS Ultraclusters; Foundation models; LLM optimization and governance.
Ideal Candidate
The ideal candidate is a senior lead AI engineer with 6+ years of AI/ML experience, deep proficiency in Python/Go/Scala/Java, and hands-on experience with LLMs, vector databases, and guardrails on GenAI platforms.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 6 years of experience developing AI and ML algorithms or technologiesAt least 6 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholdersExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systemsand judiciously apply novel techniques in productionExcellent communication and presentation skillswith the ability to articulate complex AI concepts to peers
Required Skills
PythonGoScalaJavaPyTorchHuggingFaceVectorDBsNemo GuardrailsAWS UltraclustersFoundation Model TrainingFoundation modelsLLM inferenceSimilarity searchGuardrailsMemoryModel evaluationExperimentationGovernanceObservability
Hard Skills
PythonGoScalaJavaLLM InferenceSimilarity SearchVectorDBsGuardrailsMemoryNemo GuardrailsPyTorchHuggingFaceAWS UltraclustersFoundation Model TrainingFoundation modelsLLM optimizationML platform servicesGenAI
Soft Skills
CommunicationLeadershipMentoringCross-functional collaborationProblem solvingAdaptability
Keywords for Your Resume
senior lead ai engineerai engineercapital oneifxfoundation modelsllm inferencevectordbsnemo guardrailshuggingfacepytorchaws ultraclustersawsamazon web servicespythongoscalajavallm optimizationguardrailsmemorymodel evaluationexperimentationgovernanceobservabilitycloud platformsfoundation model training
Deal Breakers
Bachelor's degree or higher in a related field, 4+ years AI/ML experience for Master’s candidates, On-site requirement in listed locations
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile