About this role
This role involves developing and deploying advanced AI systems, focusing on large language models, AI infrastructure, and responsible AI practices within a financial services context.
Key Responsibilities
- Partner with cross-functional teams
- Design, develop, test, deploy AI software
- Leverage open source and SaaS AI technologies
- Invent LLM optimization techniques
- Contribute to technical vision
Technical Overview
The technical environment includes Python, PyTorch, Huggingface, AWS Ultraclusters, VectorDBs, Nemo Guardrails, and AI model training and inference techniques.
Ideal Candidate
The ideal candidate is a mid-level AI engineer with experience in machine learning, deep learning, and large language models. They are proficient with PyTorch, Huggingface, and open source AI tools, and have a passion for building scalable AI systems in a collaborative environment.
Must-Have Skills
Partner with cross-functional teamsDesigndeveloptestdeploy AI softwareLeverage open source and SaaS AI technologiesInvent state-of-the-art LLM optimization techniquesContribute to technical vision
Nice-to-Have Skills
Experience with foundation model trainingLarge language model inferenceSimilarity searchAI governanceAI experimentationAI observability
Tools & Platforms
AWS UltraclustersHuggingfacePyTorchVectorDBsNemo Guardrails
Required Skills
Partner with cross-functional teamsDesigndeveloptestdeploy AI software components including foundation model traininglarge language model inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceand observabilityLeverage a broad stack of Open Source and SaaS AI technologies such as AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchand more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance - scalabilitycostlatencythroughput - of large scale production AI systems. Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
Hard Skills
PythonPyTorchHuggingfaceLarge Language ModelsOpen Source AI TechnologiesSaaS AI TechnologiesAWS UltraclustersVectorDBsNemo GuardrailsModel TrainingModel InferenceSimilarity SearchModel EvaluationExperimentationGovernanceObservabilityAI Infrastructure
Soft Skills
CollaborationProblem-solvingAdaptabilityCommunicationTeamworkInnovationClarity
Keywords for Your Resume
AI engineerMachine LearningDeep LearningLarge Language ModelsLLMPyTorchHuggingfaceAI infrastructureModel trainingModel inferenceAI governanceAI observabilityOpen Source AISaaS AIVectorDBsNemo GuardrailsAI optimizationAI experimentationmachine learningdeep learninglarge language modelsmodel trainingmodel inference
Deal Breakers
Lack of experience with AI model training or inference, No familiarity with open source AI tools, No experience in scalable AI infrastructure, Unwillingness to collaborate across teams
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile