Position Details
About this role
This role involves leading data engineering projects focused on large-scale, real-time financial data processing using big data technologies and cloud infrastructure.
Key Responsibilities
- Design data pipelines
- Implement real-time streaming
- Optimize cloud infrastructure
- Collaborate on data architecture
- Lead data engineering projects
Technical Overview
Utilizes Python, Java, Scala, Apache Spark, Hadoop, Kafka, and cloud platforms like AWS, Azure, GCP, with containerization tools such as Docker and Kubernetes, supporting scalable data pipelines.
Ideal Candidate
The ideal candidate is a lead data engineer with over 3 years of experience in big data frameworks, cloud platforms, and containerization. They possess strong programming skills in Python, Java, or Scala and have experience working with financial data and real-time streaming.
Must-Have Skills
Nice-to-Have Skills
Tools & Platforms
Required Skills
Hard Skills
Soft Skills
Industry & Role
Keywords for Your Resume
Deal Breakers
Less than 3 years in data engineering roles, Lack of experience with big data frameworks, No experience with cloud platforms or containerization
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile