About this role
This role involves designing and building scalable data pipelines and managing data integration projects for government and defense clients.
Key Responsibilities
- Build data pipelines
- Integrate data sources
- Ensure data quality
- Automate workflows
- Collaborate with cross-functional teams
Technical Overview
The technical environment includes SQL, Python, Scala, Spark, Java, cloud data platforms like Azure and AWS, and data pipeline tools such as Apache NiFi and Airflow.
Ideal Candidate
The ideal candidate is a mid-level data engineer with at least 6 years of experience in data pipeline development, ETL/ELT processes, and cloud data platforms, with a security clearance and strong programming skills.
Must-Have Skills
3+ years of experience with coding in software programming languages including SQLPythonScalaSpark or JavaExperience with building scalable ETL or ELT data pipelinesKnowledge of different database types including SQLNoSQLor GraphSecret clearanceBachelor's degree and 6+ years of experience or 10+ years of experience in data integration and pipelines
Nice-to-Have Skills
Data management principlesData modelingData transformationData validationData analysisApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeDevOps principlesCI / CD toolsJenkinsGitHub ActionsNexusArtifactory
Tools & Platforms
Apache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeJenkinsGitHub ActionsNexusArtifactory
Required Skills
SQLPythonScalaSparkJavaETLELTREST APINoSQLJSONXMLApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeDevOpsJenkinsGitHub ActionsNexusArtifactory
Hard Skills
SQLStructured Query LanguagePythonScalaSparkJavaETLELTREST APIDatabasesNoSQLJSONXMLData pipelinesApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeDevOpsJenkinsGitHub ActionsNexusArtifactory
Soft Skills
team collaborationagile environmentadaptabilityanalytical explorationdata examination
Keywords for Your Resume
Data EngineerSQLPythonScalaSparkJavaETLELTREST APIDatabasesNoSQLJSONXMLApache NiFiAirflowAzure Data FactoryAWS GlueDatabricksSnowflakeDevOpsJenkinsGitHub ActionsNexusArtifactoryData pipelines
Deal Breakers
Lack of Secret clearance, Less than 6 years of relevant experience, No experience with data pipelines or ETL/ELT, No experience with cloud data tools, No degree or equivalent experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile