Position Details
About this role
This role involves developing and maintaining scalable data processing solutions using Apache Spark and Python, collaborating with cross-functional teams to optimize data workflows.
Key Responsibilities
- Design and develop data pipelines
- Optimize data workflows
- Troubleshoot data jobs
- Ensure data quality and integrity
- Collaborate with data teams
Technical Overview
The technical environment includes Apache Spark, Hadoop ecosystem, Python, Scala, and SparkSQL for big data processing and analytics.
Ideal Candidate
The ideal candidate is a senior data engineer with 5+ years of experience in big data processing, proficient in Apache Spark and Python, capable of designing scalable data pipelines and ensuring data quality.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Certifications
Required
Industry & Role
Keywords for Your Resume
Deal Breakers
Lack of experience with Apache Spark and Python, No relevant certifications, Less than 5 years of experience, Not located in Tampa, FL
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile