Position Details

Type Not Specified

Experience senior

Exp. Years 3+ years

Education Bachelor's/master's degree in computer science, Information Technology, or a related field

Category Data & Analytics

About this role

This role involves designing and developing data pipelines and systems for high-performance data processing, leveraging cloud platforms and distributed frameworks to support financial index data analysis.

Key Responsibilities

Design and develop data pipelines
Manage real-time data streams
Optimize data processing systems
Collaborate on system architecture
Ensure data quality and scalability

Technical Overview

Focuses on Python-based data engineering, real-time streaming, cloud platforms (AWS, Azure), distributed computing frameworks like Spark and Kafka, and data architecture for index data processing.

Ideal Candidate

The ideal candidate is a senior data engineer with over 3 years of experience in Python, data pipelines, and cloud platforms like AWS and Azure. They should have strong skills in real-time data streaming, distributed computing, and data architecture.

Must-Have Skills

PythonData pipelinesCloud platforms (AWSAzure)Data engineeringDistributed computing

Nice-to-Have Skills

Real-time data streamingData lake architecturesAlgorithmsData structuresSparkKafkaJenkins

Tools & Platforms

Apache SparkKafkaAWSMicrosoft AzureJenkinsGit

Required Skills

PythonData pipelinesData engineeringApache SparkKafkaReal-time data streamingCloud platformsAWSAzureData lakeAlgorithmsData structuresDistributed computingData processingJenkinsGit

Hard Skills

PythonPythonData pipelinesData engineeringApache SparkKafkaReal-time data streamingCloud platformsAWSMicrosoft AzureData lake architecturesAlgorithmsData structuresSoftware architectureDistributed computingData processingJenkinsGit

Soft Skills

CollaborationProblem-solvingAnalytical skillsTeamworkCommunication

Industry & Role

Industry Financial Data / Indexing

Job Function Senior data engineering and pipeline development

Keywords for Your Resume

Senior Software DeveloperPythonData pipelinesData engineeringApache SparkKafkaReal-time data streamingCloud platformsAWSMicrosoft AzureData lakeAlgorithmsData structuresDistributed computingData processingJenkinsGitAzure

Deal Breakers

Lack of experience with cloud platforms (AWS, Azure), No proficiency in Python, No experience with data pipelines or data engineering, Unfamiliarity with distributed computing frameworks

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Software Developer - Python , Data Engineering

Get matched to jobs like this