About this role
This role involves developing and maintaining large-scale data pipelines and applications, leveraging cloud and big data technologies to support mission-driven projects.
Key Responsibilities
- Develop data pipelines
- Maintain data applications
- Work with cloud platforms
- Ensure data security
- Support real-time data processing
Technical Overview
The technical environment includes Python, SQL, Scala, Java, Spark, Hadoop, Kafka, NoSQL databases, and cloud platforms like AWS and Azure.
Ideal Candidate
The ideal candidate is a senior data engineer with over 7 years of experience in application development, data pipelines, and cloud platforms like AWS and Azure. They have strong skills in big data tools, NoSQL databases, and data warehousing, with security clearance.
Must-Have Skills
7+ years of application development7+ years designing and maintaining complex data applications5+ years creating software for structured and unstructured data5+ years developing scalable ETL and ELT workflowsExperience with PythonSQLScalaJavaExperience with cloud platforms including AWSAzureor Google CloudExperience with distributed data tools including SparkHadoopKafkaExperience with NoSQL databases like MongoDB or CassandraExperience with data warehousing including SnowflakeRedshiftMySQLSecret clearance
Nice-to-Have Skills
Experience with AWS EMRExperience with HadoopExperience with KafkaExperience with UNIX/Linux scriptingExperience with real-time streamingExperience with Agile practicesTS/SCI clearance with polygraph
Tools & Platforms
PythonSQLScalaJavaSparkHadoopHiveAWS EMRKafkaMongoDBCassandraSnowflakeRedshiftMySQLUNIXLinux
Required Skills
PythonSQLScalaJavaETLELTData PipelinesData EngineeringSparkHadoopHiveAWS EMRKafkaNoSQLMongoDBCassandraSnowflakeRedshiftMySQLUNIXLinuxAgile
Hard Skills
PythonSQLScalaJavaETLELTData PipelinesData EngineeringDistributed DataSparkHadoopHiveAWS EMRKafkaNoSQLMongoDBCassandraData WarehousingRedshiftMySQLSnowflakeUNIXLinuxShell scriptingAgile
Soft Skills
LeadershipCollaborationMentoringProblem-solvingCommunication
Certifications
Required
Secret clearance
Preferred
TS/SCI clearance with polygraph
Keywords for Your Resume
data engineerpythonsqlscalajavaetleltdata pipelinesdistributed datasparkhadoophiveaws emrkafkanosqlmongodbcassandraredshiftmysqlsnowflakeunixlinuxshell scriptingagiledata warehousingdata engineeringbig datacloud platforms
Deal Breakers
Less than 7 years of experience, No security clearance, Lack of experience with cloud data tools, Inability to work in hybrid environment, Location outside Tampa, FL
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile