Position Details
About this role
This role involves designing and implementing scalable data pipelines and architectures in a cloud environment to support analytics and business intelligence.
Key Responsibilities
- Design data pipelines
- Implement ETL processes
- Optimize data workflows
- Collaborate with data scientists
- Maintain data architecture
Technical Overview
Utilizes Python, SQL, Spark, Hadoop, and AWS to develop data solutions, manage large datasets, and optimize data workflows.
Ideal Candidate
The ideal candidate is a senior data engineer with extensive experience in building scalable data pipelines using Python, SQL, and cloud platforms like AWS. They should have a strong background in big data technologies such as Spark and Hadoop, and be capable of designing efficient data architectures.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Lack of experience with AWS or cloud platforms, No experience with Spark or Hadoop, No data engineering background
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile