About this role
Lead AI Engineer within Capital One's Gen AI platform services to deliver AI-powered products and foundational AI systems, focusing on scalable model training, inference, and optimization.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, and deploy AI components
- Leverage Open Source and SaaS AI technologies
- Invent optimization techniques for training and inference
- Contribute to long-term AI foundational systems roadmap
Technical Overview
Hands-on AI systems engineering using PyTorch, HuggingFace, and VectorDBs on cloud platforms (AWS). Responsibilities include foundation model training, LLM inference, guardrails, and observability.
Ideal Candidate
The ideal candidate is a lead AI engineer with 4+ years in AI/ML, strong experience deploying AI services on cloud platforms, and a track record mentoring teams and collaborating across functions to deliver AI-powered solutions.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 4 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience designingdevelopingdeliveringand supporting AI servicesExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systems
Tools & Platforms
Amazon Web ServicesAWSHuggingFacePyTorchVectorDBsNemo GuardrailsUltraclusters
Required Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields; 4+ years AI/ML; 4+ years Python/Go/Scala/Java
Hard Skills
PythonGoScalaJavaPyTorchHuggingfaceVectorDBsNemo GuardrailsAWS Ultraclusters
Soft Skills
Strong communicationMentoringCross-functional collaborationProblem solvingLeadership
Keywords for Your Resume
Lead AI EngineerMLXAgentic AIGen AI platform Servicesfoundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityHuggingfacePyTorchVectorDBsNemo GuardrailsAWS UltraclustersPythonJavaGollm inferencevectorDBsHuggingFace
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile