About this role
Lead AI Engineer driving GenAI platform services, including foundation models, LLM inference, and guardrails in Capital One's AI ecosystem.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, deploy, and support AI components
- Leverage AI technologies
- Invent and apply LLm optimization techniques
- Contribute to foundational AI systems roadmap
Technical Overview
Stack includes foundation model training, LLM inference, PyTorch, Hugging Face, VectorDBs, Nemo Guardrails, AWS Ultraclusters; emphasis on performance optimization and governance.
Ideal Candidate
The ideal candidate is a senior/lead AI engineer with deep experience building and scaling AI services and GenAI platforms, leading cross-functional teams and delivering production-grade AI features.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fieldsAt least 6 years of experience developing AI and ML algorithms or technologiesAt least 6 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholdersExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systemsand judiciously apply novel techniques in productionExcellent communication and presentation skillswith the ability to articulate complex AI concepts to peers
Tools & Platforms
AWS UltraclustersAmazon Web Services UltraclustersHugging FaceVectorDBsNemo GuardrailsPyTorch
Required Skills
foundation model traininglarge language model inferenceguardrailsNemo GuardrailsVectorDBsHugging FacePyTorchPythonGoJavaScalaAWS Ultraclusters
Hard Skills
PythonGoScalaJavaPyTorchHugging FaceAWS UltraclustersAmazon Web Services UltraclustersVectorDBsNemo GuardrailsFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsModel evaluationObservabilityGovernance
Soft Skills
Strong collaborationExcellent communicationProblem solvingAdaptabilityMentoring/leadershipTeam orientation
Keywords for Your Resume
Senior Lead AI EngineerMLXAgentic AIGen AI platform Servicesfoundation model traininglarge language model inferenceguardrailsNemo GuardrailsVectorDBsHugging FacePyTorchPythonGoJavaScalaAWS UltraclustersAmazon Web Services UltraclustersLLM inferencemodel evaluation
Deal Breakers
Bachelor's degree not specified, Less than 4 years AI/ML experience, No experience with Python/Go/Scala/Java, No experience with PyTorch or Hugging Face, No cloud experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile