About this role
Distinguished AI Engineer to lead AI/ML initiatives, architect and deliver production-grade AI systems, and mentor engineering teams across multiple locations for Capital One.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
- Invent state-of-the-art LLM optimization techniques to improve performance
- Contribute to the technical vision and long term roadmap of foundational AI systems
Technical Overview
Expertise with foundation models, LLM optimization, guardrails, vector databases, PyTorch, HuggingFace, and cloud deployment. Proficient in Python, Go, Scala, Java and cloud platforms (AWS/GCP/Azure).
Ideal Candidate
The ideal candidate is a distinguished AI engineer with 6-8+ years of AI/ML experience, deep expertise in foundation models and LLMs, strong cloud experience (AWS, GCP, Azure), and a proven ability to lead and mentor multiple teams while influencing cross-functional stakeholders.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 8 years of experience developing AI and ML algorithms or technologiesor a Master's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 6 years of experience developing AI and ML algorithms or technologiesAt least 8 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience architectingdesigningdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP levelExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costExcellent communication and presentation skills
Tools & Platforms
PythonGoScalaJavaC++C#GolangHuggingfaceVectorDBsNemo GuardrailsPyTorchAWSAmazon Web ServicesGoogle Cloud PlatformAzureKubernetesDocker
Required Skills
Bachelor's degree; 8+ years AI/ML; Python/Go/Scala/Java; AWS/Google Cloud/Azure; PyTorch; HuggingFace; VectorDBs; Nemo Guardrails; LLM Inference; Docker; Kubernetes; CI/CD; Agile
Hard Skills
PythonGoScalaJava8 years of experienceKubernetesDockerAWSAmazon Web ServicesCloud platformsPyTorchHuggingfaceVectorDBsNemo GuardrailsLLM Inference
Soft Skills
TechnicalMentoringCommunicationLeadershipProblem-solving
Keywords for Your Resume
Distinguished AI EngineerAI EngineerArtificial IntelligenceMachine Learningfoundation model traininglarge language modelLLMguardrailsmodel evaluationexperimentationgovernanceobservabilityHuggingfaceVectorDBsNemo GuardrailsPyTorchAWS UltraclustersPythonGoScalaJavaC++C#GolangAWSGoogle CloudAzurecloud platformsLLM optimizationLLM Inferenceproduction AI systems
Deal Breakers
Lack of cloud platform experience (AWS, Google Cloud, or Azure), Less than 6 years of AI/ML experience (or 8+ with Bachelor’s), No experience with LLMs or agent tooling
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile