Position Details

Salary $161K – $184K USD / year

Type Full-Time

Experience mid

Exp. Years 1+ years in big data technologies

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing and developing data pipelines and solutions using big data tools and cloud platforms to support enterprise data needs.

Key Responsibilities

Design data pipelines
Develop scalable data solutions
Collaborate with cross-functional teams
Support cloud migration
Optimize data processing workflows

Technical Overview

The technical environment includes Java, Scala, Python, Hadoop, Spark, Kafka, NoSQL databases, cloud data warehouses like Redshift and Snowflake, and cloud platforms such as AWS, Azure, and Google Cloud.

Ideal Candidate

The ideal candidate is a mid-level data engineer with 3+ years of experience in application development and at least 1 year working with big data technologies, cloud data warehousing, and distributed systems. They should be proficient in programming languages like Java, Scala, and Python, and familiar with cloud platforms such as AWS, Azure, or Google Cloud.

Must-Have Skills

Bachelor's Degreeat least 3 years of application developmentat least 1 year of big data technologies

Nice-to-Have Skills

PythonSQLScalaJavaAWSMicrosoft AzureGoogle CloudMapReduceHadoopHiveEMRKafkaSparkMongoDBCassandraRedshiftSnowflakeUNIX/Linuxshell scriptingAgile

Tools & Platforms

RedshiftSnowflakeHadoopHiveKafkaSparkMongoDBCassandraUNIX/Linuxshell scriptingAgile

Required Skills

JavaScalaPythonOpen Source RDBMSNoSQLRedshiftSnowflakeHadoopHiveKafkaSparkAWSAzureGoogle CloudShell scriptingAgile

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeBig Data TechnologiesDistributed MicroservicesCloud Data Warehousing

Soft Skills

collaborationproblem-solvingmentoringlearningteamwork

Industry & Role

Industry Fintech

Job Function Data engineering and big data solution development

Keywords for Your Resume

Data EngineerBig DataDistributed MicroservicesJavaScalaPythonOpen Source RDBMSNoSQLRedshiftSnowflakeHadoopHiveKafkaSparkAWSMicrosoft AzureGoogle CloudShell scriptingAgileBig Data Technologies

Deal Breakers

Lack of Bachelor's Degree, Less than 1 year of big data experience, No experience with cloud data warehousing, No proficiency in Java, Scala, or Python

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Data Engineer

Get matched to jobs like this