About this role
Scale AI seeks a Software Engineer for Public Sector to build backend systems for Federal customers, ingest federal datasets, and develop AI-enabled features with cloud-native infrastructure and agentic capabilities.
Key Responsibilities
- Design scalable backend systems for Federal customers
- Build data pipelines and ML infrastructure
- Develop agentic features with multi-layer guardrails
- Collaborate with cross-functional teams and customers
- Define requirements with stakeholders and drive features to production
Technical Overview
Role focuses on backend systems, data pipelines, ETL, AI integration with LLMs, and cloud platforms (AWS, Azure, GCP) with containerization (Docker, Kubernetes).
Ideal Candidate
The ideal candidate is a mid- to senior-level software engineer with strong cloud and data pipeline experience who can design scalable backend systems for federal customers and translate requirements into production-ready platforms that leverage LLMs and RAG.
Must-Have Skills
Full Stack Development: Proficiency in front-endback-end development and infrastructureCloud-Native Technologies: Familiarity with cloud platforms (e.g.AWSAzureGCP) and cloud-native developmentData Engineering: Knowledge of ETL (ExtractTransformLoad) processes and building data pipelinesAI Application Integration: Familiarity with integrating Large Language Models (LLMs) and building agentic workflows; knowledge of prompt engineeringretrieval-augmented generation (RAG)and agent orchestration
Nice-to-Have Skills
Experience with LLMs and agent orchestrationExperience with robotics or Federal/defense techKnowledge of security and governance in data platforms
Tools & Platforms
Amazon Web ServicesAWSMicrosoft AzureAzureGoogle Cloud PlatformGCPKubernetesDockerETLData pipelines
Required Skills
Full Stack Development; Cloud-Native Technologies; Data Engineering; AI Application Integration; Prompt engineering; Retrieval-Augmented Generation; Agent orchestration; Cloud platforms; ETL; Data pipelines; Data modeling; Data warehousing; Data governance; LLMs; RAG; guardrails; real-time decision-making
Hard Skills
Amazon Web ServicesAWSMicrosoft AzureAzureGoogle Cloud PlatformGCPKubernetesDockerETLData pipelinesData modelingData warehousingData governanceLarge Language ModelsLLMsprompt engineeringRetrieval-Augmented Generationagent orchestrationFull Stack DevelopmentCloud-Native Technologies
Soft Skills
CommunicationCollaborationProblem-solvingAdaptabilityLearning AgilityInterpersonal skills
Keywords for Your Resume
software engineerpublic sectorfederalcloud-nativeAmazon Web ServicesAWSMicrosoft AzureAzureGoogle Cloud PlatformGCPKubernetesDockerETLData pipelinesData modelingData warehousingData governanceLarge Language ModelsLLMsprompt engineeringRetrieval-Augmented Generationagent orchestrationfull stack developmentguardrailsreal-time decision-making
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile