Position Details

Salary $110K – $125K USD / year

Type Full-Time

Experience mid

Exp. Years 3+ years

Education Not specified

Category Software Engineering

About this role

Design and implement Python-based automation to support reconciliation, including robust ETL pipelines for data integration. Build, test, and deploy scalable workflows in cloud and enterprise data environments.

Key Responsibilities

Design, develop, and maintain ETL pipelines
Refactor and validate Python automation with test cases
Implement scalable solutions using Python with Databricks and Apache Airflow
Troubleshoot pipeline issues and ensure data integrity
Collaborate with stakeholders to translate requirements into maintainable solutions

Technical Overview

The role centers on Python automation and ETL workflows that extract, transform, and load data into an integrated platform. The stack includes Databricks and Apache Airflow, with AWS services such as AWS Lambda and Amazon S3, plus SQL database development/maintenance/administration. It also includes testing and troubleshooting to ensure data integrity across systems.

Ideal Candidate

The ideal candidate is a Python-focused data automation engineer with 3+ years building and refactoring Python for ETL data pipelines and reconciliation workflows. They have strong SQL database experience (3+ years) and hands-on cloud data platform skills using Databricks and Apache Airflow, plus AWS Lambda and Amazon S3. They are a U.S. citizen able to pass a background investigation, with DHS clearance (CBP/ICE) or DoD Top-Secret preferred and OCR/Document Understanding experience a plus.

Must-Have Skills

PythonETL pipelinesSQL databasesDatabricksApache AirflowAWS LambdaAmazon S3U.S. citizenship able to pass a background investigation by the client agency

Nice-to-Have Skills

Optical Character Recognition (OCR)AWS TextractTesseractlayout-aware modelsDevOps practicesCI/CDcontainerized deploymentversion control

Tools & Platforms

DatabricksApache AirflowAWS LambdaAmazon S3AWS TextractTesseract

Required Skills

PythonETL data pipelinesSQL databasesDatabricksApache AirflowAWS LambdaS3data architecturedata integrityOptical Character Recognition (OCR)AWS TextractTesseractDevOps practicesversion controlCI/CDcontainerized deployment

Hard Skills

PythonETL data pipelinesdata integrationdata extractiontransformload dataPython automation scriptsPython workflowsrefactor existing codeSQL databasesdeveloping SQL databasesmaintaining SQL databasesadministering SQL databasesdata architecturedata integritydata pipeline troubleshootingDatabricksApache AirflowAWS LambdaAmazon S3cloud-based platformstest casesdeploy Python automationCI/CDversion controlcontainerized deploymentOptical Character Recognition (OCR)AWS TextractTesseractdocument understanding frameworkslayout-aware modelsDHS clearance with CBP/ICEDoD Top-Secret

Soft Skills

collaboration with technical leads and stakeholderstranslating requirements into well-architectedmaintainable solutionsaccuracyefficiencyand reliability focustroubleshooting and issue resolutionworking in cloud and enterprise data environments

Industry & Role

Industry Manufacturing

Job Function Build and deploy Python ETL automation to run reconciliation processes and integrate enterprise data

Role Subtype Backend Engineer

Tech Domains Python, SQL / PostgreSQL, Amazon Web Services, Data & Analytics, Cybersecurity

Clearance & Visa

Visa Sponsorship No

Keywords for Your Resume

Python DeveloperPython based automationETL data pipelinesextracttransformloadPython automation scriptsPython workflowsSQL databasesDatabricksApache AirflowAWS servicesAWS LambdaS3Amazon S3data architecturedata pipeline issuesdata integrityOptical Character Recognition (OCR)OCRAWS TextractTesseractlayout-aware modelsDevOpsversion controlCI/CDcontainerized deploymentU.S. citizenbackground investigationDHS clearance with CBP/ICEDoD Top-Secretreconciliation processPython

Deal Breakers

3+ years of experience with Python, U.S. citizenship required (must be able to pass a background investigation by the client agency)

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile