About this role
Senior Principal AI Software Engineer/Generative AI Architect responsible for designing and delivering enterprise AI applications with guardrails and scalable workflows, collaborating across product, platform, and security teams.
Key Responsibilities
- Architect and build enterprise-grade Generative AI applications that combine LLMs, retrieval, and structured data access
- Design agentic systems and multi-step reasoning workflows
- Build durable, fault-tolerant orchestration for long-running AI workflows
- Define architectures for data from multiple sources and guardrails for safe production
- Lead reviews and mentor engineers to raise reliability and security
Technical Overview
Hands-on with LLMs, agentic workflows, retrieval pipelines, and vector stores; architecture for distributed, cloud-native AI platforms; experience with Elasticsearch/OpenSearch, Kubernetes, Temporal or equivalent workflows, and model routing/observability.
Ideal Candidate
The ideal candidate is a senior principal AI software engineer with deep hands-on experience shipping production AI/LLM-powered applications, strong background in agentic workflows, and ability to drive architecture across product, platform, and security teams.
Must-Have Skills
BSMSor PhD in Computer ScienceEngineeringor a related fieldor equivalent practical experience10+ years of experience building large-scale distributed systemsProven experience designing and shipping production AI or LLM-powered applicationsPython and at least one additional language such as Go or JavaExperience with LangGraph or equivalent frameworksTemporal or similar durable workflow orchestrationExperience designing reasoning systems across structured and unstructured dataDeep experience with vector storesembeddingsretrieval pipelinesExperience with Elasticsearch or OpenSearchExperience building LLM evaluation frameworksExperience implementing AI guardrails and safety controlsStrong knowledge of distributed systems fundamentalscloud-native architectureobservability
Nice-to-Have Skills
Experience building vertical AI applications for cybersecurity IT operationsExperience with hybrid retrieval and ranking techniquesEvaluation-driven development for LLM systemsAI observability platformsExperience building shared AI infrastructure or internal AI platformsFamiliarity with cloud platforms (AWSGCP) and Kubernetes/Terraform
Tools & Platforms
PythonJavaLangGraphTemporalElasticsearchOpenSearchGoogle Cloud PlatformAmazon Web ServicesKubernetesTerraform
Required Skills
BS/MS/PhD in CS or related; 10+ years distributed systems; production AI/LLM apps; Python; Go or Java; LangGraph; Temporal; vector stores; embeddings; Elasticsearch/OpenSearch; Kubernetes; Terraform; AWS; Google Cloud Platform; cloud-native; observability; AI guardrails
Hard Skills
PythonGoJavaLangGraphTemporalLLMvector storesembeddingsElasticsearchOpenSearchdistributed systemscloud-native architectureKubernetesTerraformAmazon Web ServicesGoogle Cloud Platform
Soft Skills
Excellent communicationCollaborationLeadershipMentorshipInfluence
Keywords for Your Resume
Senior Principal AI Software EngineerGenerative AI Applications ArchitectLLMLangGraphTemporalvector storesembeddingsElasticsearchOpenSearchretrieval augmented generationRAGAI guardrailssecurity controlscloud-nativeKubernetesTerraformAWSGoogle Cloud PlatformPythonGoJavadistributed systemsproduction AIobservabilityVector stores
Deal Breakers
Lack of 10+ years in distributed systems, No production AI/LLM experience, No experience with guardrails or agentic systems
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile