Position Details

Type Not Specified

Experience mid

Exp. Years 6+ years or 10+ years in data pipelines

Education Bachelor's degree and 6+ years of experience or 10+ years of experience in data pipelines

Category Data & Analytics

About this role

Responsible for designing, building, and maintaining scalable data pipelines and platforms to support data-driven decision making for clients.

Key Responsibilities

Build scalable data pipelines
Implement data integration solutions
Manage data platforms
Collaborate with analysts and developers
Ensure data security and compliance

Technical Overview

Focus on data engineering using SQL, Python, Spark, and cloud data tools like AWS Glue, Databricks, and Snowflake in an Agile environment.

Ideal Candidate

The ideal candidate is a mid to senior-level data engineer with 6+ years of experience in building scalable data pipelines using tools like Spark, Python, and SQL. They should have experience with cloud data platforms, data modeling, and working in Agile environments, with a security clearance.

Must-Have Skills

3+ years of coding experiencebuilding scalable ETL or ELT data pipelinesknowledge of SQLNoSQLor Graph databasesexperience with data engineering toolsability to work in Agile environmentSecret clearance

Nice-to-Have Skills

data management principlesdata modelingdata transformationdata validationdata analysisDevOps principlesCI / CD tools

Tools & Platforms

Apache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeJenkinsGitHub ActionsNexusArtifactory

Required Skills

SQLPythonScalaSparkJavaETLELTREST APINoSQLGraph databasesApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeJenkinsGitHub ActionsNexusArtifactory

Hard Skills

SQLStructured Query LanguagePythonScalaSparkJavaETLELTREST APIdatabasesJSONXMLNoSQLGraph databasesApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeJenkinsGitHub ActionsNexusArtifactory

Soft Skills

adaptabilityfast-paced environmentcollaborationproblem-solvingcommunication

Certifications

Required

Secret clearance

Industry & Role

Industry Manufacturing

Job Function Data pipeline development and data platform management

Clearance & Visa

Clearance Required Secret

Keywords for Your Resume

Data EngineerSQLPythonScalaSparkJavaETLELTREST APIdatabasesNoSQLGraph databasesApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeJenkinsGitHub ActionsNexusArtifactorydata pipelinesdata engineeringAgileSecret clearance

Deal Breakers

Lack of experience with data engineering tools, No experience with ETL/ELT pipelines, No security clearance

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Commodity Product Manager

Get matched to jobs like this