Position Details

Salary $77K – $176K USD / year

Type Not Specified

Experience senior

Exp. Years 3+ years

Education Bachelor's degree

Category Data & Analytics

About this role

This role involves designing and implementing data pipelines for real-time and batch processing, supporting national security and intelligence missions.

Key Responsibilities

Develop data pipelines
Implement real-time data processing
Manage data security and compliance
Collaborate with security teams
Optimize data workflows

Technical Overview

Technical environment includes Kafka, NiFi, cloud automation with Terraform and Ansible, and data pipeline development with Java, Python, and SQL.

Ideal Candidate

The ideal candidate is a senior data engineer with at least 3 years of experience in ETL development, data pipeline architecture, and working with Kafka and NiFi. They hold a TS/SCI clearance and are familiar with real-time data processing and cloud automation tools.

Must-Have Skills

3+ years of experience with data pipelines3+ years of experience in ETL development using JavaPythonSQLor Scala2+ years of experience with PostgreSQL or KafkaTS/SCI clearance with a polygraphBachelor's degreeAbility to obtain a Security+ Certification within 6 months

Nice-to-Have Skills

Kafka ecosystem toolsNiFiTerraformAnsibleAgile methodologiesReal-time data processingStreaming applications

Tools & Platforms

KafkaKafka ConnectKafka StreamsNiFiTerraformAnsible

Required Skills

JavaPythonSQLScalaPostgreSQLKafkaKafka ConnectKafka StreamsNiFiTerraformAnsibleAgileReal-time dataStreaming applications

Hard Skills

JavaPythonSQLScalaPostgreSQLKafkaKafka ConnectKafka StreamsNiFiTerraformAnsibleAgileReal-time dataStreaming applications

Soft Skills

independent workteamworkproblem-solvinganalytical skillsattention to detail

Certifications

Required

TS/SCI clearanceSecurity+ Certification

Industry & Role

Industry Government/Public Sector

Job Function Design and develop secure, scalable data pipelines for mission-critical applications

Clearance & Visa

Clearance Required TS/SCI

Keywords for Your Resume

Data EngineerJavaPythonSQLScalaPostgreSQLKafkaKafka ConnectKafka StreamsNiFiTerraformAnsibleAgileReal-time dataStreaming applicationsSecurity+ CertificationTS/SCI clearanceSecurity+

Deal Breakers

Lack of TS/SCI clearance, No experience with Kafka or NiFi, Less than 3 years of relevant experience, No Bachelor's degree

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Data Engineer, Senior

Get matched to jobs like this