Position Details

Salary $77K – $176K USD / year

Type Not Specified

Experience senior

Exp. Years 8+ years

Education Bachelor's degree

Category Data & Analytics

About this role

This role involves designing and maintaining large-scale data storage and processing systems for government clients, focusing on security, scalability, and data governance.

Key Responsibilities

Design data storage solutions
Build scalable ETL pipelines
Manage data security and compliance
Optimize data system performance
Collaborate with cross-functional teams

Technical Overview

Technical environment includes data warehouse and lake architectures, cloud platforms like AWS and Azure, big data processing with Spark, and data management solutions.

Ideal Candidate

The ideal candidate is a senior data engineer with over 8 years of experience in designing data warehouse and data lake architectures, building scalable ETL pipelines, and managing data systems in government or defense environments. They hold a Top Secret clearance and have expertise in cloud platforms like AWS and Azure.

Must-Have Skills

5+ years of experience designing data warehouse or data lake5+ years of experience building scalable ETL or ELT data pipelines5+ years of experience with programming languages including SQLPythonScalaSparkor JavaExperience tuning data lake architectureExperience with data management solutionsTop Secret clearanceBachelor's degree8+ years of experience in data systems design

Nice-to-Have Skills

Enterprise data and analytics system architectureAWS and Microsoft Azure cloud data productsDistributed data toolsData security policiesAutomation with Jenkins or GitHub

Tools & Platforms

AWSAzureApache SparkRedshiftBigQueryPower Apps

Required Skills

Data warehouseData lakeRESTful APIEvent processingBusiness intelligenceSQLPythonScalaSparkJavaAWSAzureData managementData catalogData governanceData lifecycle management

Hard Skills

Data warehouseData lakeRESTful APIEvent processingBusiness intelligenceSQLPythonScalaSparkJavaCloud storageData managementData catalogData governanceData lifecycle managementAWSAzureApache SparkRedshiftBigQuery

Soft Skills

designing systemsdeveloping solutionsoperationalizing data systemsteam collaborationproblem-solving

Certifications

Required

Top Secret clearance

Preferred

AWSAzureNIST 800.53FISMA

Industry & Role

Industry Government/Public Sector

Job Function Design and develop large-scale data systems for government and defense projects

Clearance & Visa

Clearance Required Top Secret

Keywords for Your Resume

Data warehouseData lakeRESTful APIEvent processingBusiness intelligenceSQLPythonScalaSparkJavaAWSAzureData managementData catalogData governanceData lifecycle managementTop Secret clearanceETLELT

Deal Breakers

Lack of Top Secret clearance, Less than 8 years of relevant experience, No experience with data warehouse or data lake design, No experience with cloud data platforms

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Data Engineer, Senior

Get matched to jobs like this