About this role
Distinguished AI Engineer leading AI/ML initiatives within Capital One’s IFX team, building scalable AI systems and production-ready foundations for GenAI.
Key Responsibilities
- Partner with cross-functional teams to deliver AI-powered products
- Design, develop, test, deploy, and support AI components including LLM training and inference
- Leverage a broad stack of Open Source and SaaS AI technologies
- Invent state-of-the-art LLM optimization techniques
- Contribute to technical vision and roadmap of AI systems
Technical Overview
Stack includes Python, Go, Scala, Java; Open Source and SaaS AI tech such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch; focus on LLM optimization, training, inference, and governance.
Ideal Candidate
The ideal candidate is a distinguished AI engineer with 6+ years of experience in AI/ML, strong programming in Python/Go/Scala/Java, and deep expertise in foundation models, LLM inference, and guardrails.
Must-Have Skills
Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 8 years of experience developing AI and ML algorithms or technologiesAt least 8 years of experience programming with PythonGoScalaor Java
Nice-to-Have Skills
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWSGoogle CloudAzureor equivalent private cloud)Experience architectingdesigningdevelopingintegratingdeliveringand supporting complex AI systemsDemonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP levelExperience developing AI and ML algorithms or technologies (e.g. LLM InferenceSimilarity Search and VectorDBsGuardrailsMemory) using PythonC++C#Javaor GolangExperience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilizationlatencythroughputand costPassion for staying abreast of the latest AI research and AI systemsand judiciously apply novel techniques in productionExcellent communication and presentation skillswith the ability to articulate complex AI concepts to peers
Required Skills
PythonGoScalaJavaPyTorchHuggingFaceVectorDBsNemo GuardrailsAWS UltraclustersFoundation modelsFoundation model trainingLLM inferenceSimilarity searchGuardrailsMemoryModel evaluationExperimentationGovernanceObservability
Hard Skills
PythonGoScalaJava8 years of experience programming with PythonGoScalaor JavaPyTorchHuggingFaceVectorDBsNemo GuardrailsFoundation model trainingLarge language model inferenceSimilarity searchGuardrailsMemoryModel evaluationExperimentationGovernanceObservabilityAWSAmazon Web Services
Soft Skills
CommunicationLeadershipMentoringCross-functional collaborationProblem solvingAdaptability
Keywords for Your Resume
distinguished ai engineerai engineercapital oneifxfoundation model trainingllm inferencevectordbsnemo guardrailshuggingfacepytorchaws ultraclustersawsamazon web servicespythongoscalajavallm optimizationguardrailsmemorymodel evaluationexperimentationgovernanceobservabilitycloud platforms
Deal Breakers
Bachelor's degree minimum in related field, 4+ years with Master's requirement on AI/ML roles, Inability to work onsite at one of the locations, Lack of experience with foundation models / LLMs
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile