Position Details

Salary $229K – $262K USD / year

Type Full-Time

Experience senior

Exp. Years 4+ years

Education Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years OR Master's degree plus 4+ years

Category AI & Machine Learning

About this role

Senior AI Engineer responsible for hosting foundation models and LLM inference, building scalable AI infrastructure, and advancing AI capabilities across banking platforms.

Key Responsibilities

Partner with cross-functional teams to deliver AI-powered products
Design, develop, test, deploy AI components including LLM inference
Leverage Open Source/SaaS AI tech like AWS Ultraclusters and VectorDBs
Develop state-of-the-art LLM optimization techniques
Contribute to long-term AI foundation systems roadmap

Technical Overview

Hands-on with Python/Go/Scala/Java and ML stack (PyTorch, Huggingface, VectorDBs); experience with AWS/GCP/Azure; focus on training/inference optimization, guardrails, governance, and observability.

Ideal Candidate

The ideal candidate is a senior AI engineer with 6+ years of AI/ML experience (4+ with a master’s) who can lead LLM inference projects, optimize model performance, and mentor a team across multi-location sites.

Must-Have Skills

Bachelor's degree in Computer ScienceAIElectrical EngineeringComputer Engineeringor related fields plus at least 6 years of experience OR Master's degree with at least 4 yearsAt least 6 years of experience programming with PythonGoScalaor Java

Nice-to-Have Skills

Cloud platforms experience (AWSGoogle CloudAzure)LLM InferenceSimilarity SearchVector databasesGuardrailsMemoryRLHF

Tools & Platforms

AWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorch

Required Skills

Bachelor's degree in CS/AI/EE/CE or related; 4+ years AI/ML; Python/Go/Scala/Java; PyTorch; Huggingface; VectorDBs; Nemo Guardrails; LLM inference; foundation model training; guardrails; observability; governance; ML optimization; cloud platforms

Hard Skills

PythonGoScalaJavaC++PyTorchHuggingfaceVectorDBsNemo GuardrailsGuardrailsLLM optimizationObservabilityGovernanceManufacturing

Soft Skills

Technical leadershipCommunicationProblem-solvingCollaborationMentorship

Industry & Role

Industry Banking

Job Function Lead the development and deployment of AI foundation models and LLM inference at scale

Role Subtype Senior AI Engineer

Tech Domains Python, Go, Scala, Java, C++, PyTorch, Huggingface, VectorDBs, Nemo Guardrails, AWS

Clearance & Visa

Visa Sponsorship Yes

Keywords for Your Resume

Senior Lead AI EngineerFM HostingLLM InferenceCapital Onefoundation model trainingLLM inferencesimilarity searchguardrailsmodel evaluationexperimentationgovernanceobservabilityOpen SourcePyTorchHuggingfaceVectorDBsNemo GuardrailsLLM optimizationMLOpsAWSGoogle CloudAzurecloud platformssenior lead ai engineerllm inferencefoundation modelspyTorchhuggingfaceaws ultraclustersvectorDBsnemo guardrailsllm optimization

Deal Breakers

No work authorization sponsorship, Lack of proficiency in core ML stacks (Python, PyTorch, etc.)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Get matched to jobs like this