About this role
This role involves leading the development and operationalization of complex data applications for government clients, ensuring secure and scalable data solutions.
Key Responsibilities
- Designing data applications
- Managing enterprise data pipelines
- Ensuring data security and compliance
- Leading cross-functional teams
- Optimizing data workflows
Technical Overview
The technical environment includes big data frameworks like Spark, Hadoop, Hive, Kafka, and enterprise data warehouses such as Redshift and Snowflake, with programming in Python, SQL, Scala, and Java, all within a secure environment.
Ideal Candidate
The ideal candidate is a senior-level data engineer with over 5 years of experience in designing and maintaining complex data applications, proficient in Python, SQL, Scala, and Java, with TS/SCI clearance. They should have extensive experience with big data tools and enterprise data pipelines.
Must-Have Skills
5+ years of experience in application development5+ years of experience designingdevelopingoperationalizingand maintaining complex data applications at enterprise scale3+ years of experience creating software for retrievingparsingand processing structured and unstructured data3+ years of experience building scalable ETL or ELT workflows for reporting and analyticsAbility to develop scripts and programs for converting various types of data into usable formatsTS/SCI clearance
Nice-to-Have Skills
Experience with PythonSQLScalaor JavaExperience with UNIX or Linuxincluding basic commands and Shell scriptingExperience with a public cloudincluding AWSMicrosoft Azureor Google CloudExperience with distributed data or computing tools such as SparkDatabricksHadoopHiveAWS EMRor KafkaExperience working on real-time data and streaming applicationsExperience with NoSQL implementationincluding MongoDB or CassandraExperience with data warehousing using AWS RedshiftMySQLor SnowflakeExperience with Agile engineering practicesTS/SCI clearance with a polygraph
Tools & Platforms
AWSAmazon Web ServicesHadoopHiveSparkDatabricksKafkaMongoDBCassandraAWS EMRRedshiftMySQLSnowflakeUNIXLinux
Required Skills
PythonSQLScalaJavaSparkHadoopHiveKafkaNoSQLMongoDBCassandraRedshiftMySQLSnowflakeUNIXLinuxShell scriptingAgile
Hard Skills
PythonPythonSQLScalaJavaSparkDatabricksHadoopHiveAWS EMRKafkaNoSQLMongoDBCassandraData warehousingAWS RedshiftMySQLSnowflakeUNIXLinuxShell scriptingAgile
Soft Skills
team leadershipcollaborativeanalytical explorationdata examination
Keywords for Your Resume
Senior Data EngineerETLELTbig dataApache SparkHadoopHiveKafkaMongoDBCassandraAWS EMRRedshiftMySQLSnowflakePythonSQLScalaJavaUNIXLinuxShell scriptingAgileTS/SCI clearance
Deal Breakers
Lack of TS/SCI clearance, Less than 5 years of relevant experience, No experience with big data tools like Spark or Hadoop, No Bachelor's degree
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile