About this role
Lead AI Engineer within Capital One's Gen AI platform services driving the development and deployment of AI-powered solutions, including foundation model training, LLM inference, and vector databases, with a strong emphasis on scalable and responsible AI.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, and support AI components
- Leverage Open Source and SaaS AI technologies
- Invent state-of-the-art optimization techniques
- Contribute to long-term AI foundational systems roadmap
Technical Overview
Role involves building AI systems with PyTorch, HuggingFace, VectorDBs, and Nemo Guardrails on cloud platforms (AWS). Responsibilities include foundation model training, LLM inference, optimization of training/inference, governance, and observability.
Ideal Candidate
The ideal candidate is a senior AI/ML engineer with 4+ years building AI systems, strong experience with foundation models, LLM inference, and productionizing AI on cloud platforms (AWS). They should excel at leading and mentoring teams and translating research into scalable, responsible AI solutions.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 4 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholdersExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software
Tools & Platforms
Amazon Web ServicesAWSHuggingFacePyTorchVectorDBsNemo GuardrailsUltraclusters
Required Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields; 4+ years AI/ML; 4+ years Python/Go/Scala/Java; PyTorch; HuggingFace; VectorDBs; Nemo Guardrails; AWS Ultraclusters; foundation model training; llm inference; similarity search; guardrails; memory; cloud platforms
Hard Skills
PythonGoScalaJavaPyTorchHuggingfaceVectorDBsNemo GuardrailsAWS UltraclustersAmazon Web Services
Soft Skills
Strong communicationMentoringCross-functional collaborationProblem solvingLeadership
Keywords for Your Resume
Senior Lead AI EngineerMLXAgentic AIGen AI platform Servicesfoundation model trainingllm inferencesimilarity searchVectorDBsNemo GuardrailsHuggingFacePyTorchAWS UltraclustersAmazon Web ServicesPythonGoScalaJavaAI EngineerAI systemsCloud platformsvectorDBsAWS
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile