Position Details

Salary $197K – $225K USD / year

Type Full-Time

Experience mid

Exp. Years 2+ years

Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Category AI & Machine Learning

About this role

Lead AI Engineer responsible for delivering AI-powered products and foundations, including foundation model training, LLM inference, and scalable AI infrastructure with governance and observability.

Key Responsibilities

Partner with cross-functional teams to deliver AI-powered products
Design and deploy AI components including training and inference
Leverage Open Source and SaaS AI technologies
Develop state-of-the-art optimization techniques for AI systems
Contribute to long-term AI systems roadmap

Technical Overview

Extensive AI/ML engineering scope including LLM concepts, vector databases, guardrails, memory management, and production-grade AI systems across cloud platforms.

Ideal Candidate

The ideal candidate is a senior/lead AI engineer with 4+ years of AI/ML development experience, strong Python/Java/Scala background, and hands-on experience deploying AI services on cloud platforms; adept at building foundation models, LLM inference, and scalable AI infrastructure with governance and observability.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 4 years of experience developing AI and ML algorithms or technologiesAt least 4 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

6 years of experience deploying scalable and responsible AI solutions on cloud platformsExperience designingdevelopingdeliveringand supporting AI servicesExperience developing AI/ML algorithms using PythonC++C#Javaor GolangExperience optimizing training and inference software for hardware utilizationlatencythroughputand costStaying current with AI research and judicious application in production

Required Skills

foundation model trainingllm inferencevectordbsnemo guardrailshuggingfacepytorchai servicesmodel governanceobservabilityexperimentation

Hard Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fieldsexperience developing AI and ML algorithms or technologiesPythonGoScalaJavaLLM inferenceVectorDBsPyTorchHuggingfaceAWS UltraclustersNemo GuardrailsGuardrailsMemoryObservabilityExperimentationGovernance

Soft Skills

technical leadershipproblem solvingcommunicationcross-functional collaborationability to articulate findingscuriosity

Industry & Role

Industry Banking

Job Function Deliver AI-powered products and foundational AI systems at Capital One.

Role Subtype Lead AI Engineer

Tech Domains Python, Go, Scala, Java, C++, Kubernetes, Docker, Amazon Web Services, Google Cloud Platform, Azure, PyTorch, VectorDBs

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

lead ai engineerai engineermachine learningfoundation model trainingllm inferencevectordbsnemo guardrailshuggingfacepytorchaws ultraclusterscapital oneifxagentic aimodel governanceobservabilityexperimentationguardrailsmemorysimilarity searchfoundation model

Deal Breakers

no cloud deployment experience, less than 2 years in AI/ML, no degree in a relevant field, no sponsorship eligibility

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Lead AI Engineer ( MLX, Gen AI Platform Services, Agentic AI)

Get matched to jobs like this