Position Details

Salary $147K – $167K USD / year

Type Full-Time

Experience mid

Exp. Years 3+ years

Education Bachelor's Degree

Category Data & Analytics

About this role

This role involves designing, developing, and supporting data engineering solutions in a fast-paced environment, focusing on big data technologies, cloud data warehouses, and full-stack systems.

Key Responsibilities

Collaborate with Agile teams to design and develop solutions
Work with machine learning and distributed microservices
Utilize cloud data warehousing services
Conduct unit tests and code reviews
Support data system transformations

Technical Overview

The technical environment includes programming in Python, Scala, Java, working with Hadoop, Kafka, Spark, and cloud data warehouses like Redshift and Snowflake, supporting machine learning and distributed microservices.

Ideal Candidate

The ideal candidate is a mid-level data engineer with 3+ years of experience in application development and big data technologies, proficient in Python, Scala, Java, and cloud data warehousing tools like Redshift and Snowflake. They should be collaborative, eager to learn, and experienced with distributed microservices and machine learning integration.

Must-Have Skills

Bachelor's Degreeat least 3 years of application development experienceat least 1 year of big data technologies experience

Nice-to-Have Skills

PythonSQLScalaJavaAWSMicrosoft AzureGoogle CloudHadoopHiveKafkaSparkMongoDBCassandraUnix/Linuxshell scriptingAgile

Tools & Platforms

RedshiftSnowflakeHadoopHiveKafkaSparkMongoDBCassandraUnix/Linux

Required Skills

PythonScalaJavaHadoopKafkaSparkRedshiftSnowflakeMongoDBCassandraapplication developmentdistributed microservicesmachine learningcloud data warehousingAgile

Hard Skills

JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed microservicesFull stack developmentCloud data warehousing

Soft Skills

collaborationproblem-solvingmentoringlearningteamworkcommunication

Certifications

Preferred

AWSMicrosoft AzureGoogle Cloud

Industry & Role

Industry Financial Services / Banking

Job Function Developing and supporting large-scale data engineering solutions in cloud and distributed environments

Role Subtype Data Engineer

Tech Domains Python, Java, Scala, Hadoop, Kafka, Spark, Redshift, Snowflake, MongoDB, Cassandra

Clearance & Visa

Clearance Required None

Visa Sponsorship No

Keywords for Your Resume

Data Engineerbig dataPythonScalaJavaRedshiftSnowflakeHadoopKafkaSparkMongoDBCassandrafull stack developmentdistributed microservicescloud data warehousingmachine learningapplication developmentAgileSQLUnix/Linuxdata engineer

Deal Breakers

Lack of Bachelor's Degree, Less than 1 year of big data experience, No experience with cloud data warehousing tools

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile

Senior Data Engineer

Get matched to jobs like this