About this role
Lead the development of a firmwide AI Development Platform, enabling scalable, secure AI capabilities across the enterprise. Own platform tooling, multi-cloud architecture, and GenAI solutions with strong governance and reliability focus.
Key Responsibilities
- Develop tooling and self-service capabilities for deploying AI solutions for the firm leveraging Kubernetes/OpenShift, Python, authentication solutions, APIs, REST framework
- Develop Terraform modules and Cloud architecture to enable secure AI cloud service deployment and consumption at scale
- Scale Generative AI use cases using pre-trained models and fine-tuned models
- Leverage Kubernetes/OpenShift to develop containerized workloads
- Publish architecture decision records and ensure reliability, monitoring, and on-call readiness
Technical Overview
Hands-on platform engineering spanning Kubernetes/OpenShift, multi-cloud (AWS/Azure/GCP), Terraform IaC, REST APIs, and AI/GenAI components (embeddings, vector stores, LangChain). Includes ADRs, blue/green deployments, and observability.
Ideal Candidate
The ideal candidate is a senior platform engineer with 10+ years of software development experience, hands-on with Kubernetes/OpenShift and multi-cloud environments, and a track record delivering enterprise-scale AI platforms. Strong GenAI, embedding, and governance experience is essential.
Must-Have Skills
Bachelor's or Master's degree in Computer Science or related field10+ years of software engineering experienceStrong hands-on experience with Python (Flask or FastAPI)Kubernetes and OpenShift experienceRESTful services and large-scale API developmentTerraform and cloud IaCAzureAWSand/or Google Cloud PlatformCI/CD with Jenkins and GitOpsData engineering fundamentals (SQLNoSQLKafkaRedis)Generative AI experience (LLMsembeddingsvector stores)LangChain or similar libraries
Nice-to-Have Skills
Unit testing and performance testingOAuth 2.0OpenTelemetry tools (GrafanaLokiPrometheusCortex)Microservice architectureBlue/Green deploymentState sharing between scalable cloud componentsDB engines (SQLRedisKafka) for cloud appsGenAI model fine-tuning and deploymentModelOps/ML Ops/LLM OpsSRE techniques
Tools & Platforms
KubernetesOpenShiftTerraformLangChainLang ChainGPTLlamaHugging FaceAPI GatewayJenkinsGrafanaPrometheusLokiCortex
Required Skills
['Kubernetes''OpenShift''Python''Flask''FastAPI''REST''APIs''Terraform''Amazon Web Services''AWS''Microsoft Azure''Azure''Google Cloud Platform''GCP''LangChain''Lang Chain''Generative AI''LLM''GPT''Llama''Hugging Face''Embeddings''Vector stores''API Gateway''CI/CD''Jenkins''GitOps''Blue/Green''Microservice''ADR''architecture decisions''Monitoring''Logging''SRE']
Hard Skills
KubernetesOpenShiftPythonFlaskFastAPIRESTAPIsTerraformAmazon Web ServicesAWSMicrosoft AzureAzureGoogle Cloud PlatformGoogle Cloud PlatformGCPLangChainLang ChainGenerative AILLMGPTLlamaHugging FaceEmbeddingsVector storesAPI GatewayCI/CDJenkinsGitOpsBlue/GreenMicroserviceADRarchitecture decisionsMonitoringLoggingSRE
Soft Skills
CommunicationTeamworkProblem-solvingAttention to detailAgileScrumOn-call readinessCross-functional collaborationLeadershipMentorship
Keywords for Your Resume
KubernetesOpenShiftPythonFlaskFastAPIRESTAPIsTerraformAmazon Web ServicesAWSMicrosoft AzureAzureGoogle Cloud PlatformGCPLangChainLang ChainGenerative AILLMGPTLlamaHugging FaceEmbeddingsVector storesAPI GatewayCI/CDJenkinsGitOpsBlue/GreenMicroserviceADRarchitecture decisionsMonitoringLoggingSREblueprintarchitecture decision records
Deal Breakers
Bachelor's degree required, 10+ years of software engineering experience, Must have Kubernetes/OpenShift enterprise experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile