Position Details

Salary $135K – $154K USD / year

Type Full-Time

Experience mid

Exp. Years 1.5 years (application development) and 1 year (big data technologies)

Education Bachelor's Degree

Category Data & Analytics

About this role

As a Data Engineer, you will design, develop, test, implement, and support data solutions in an Agile environment. You will use programming and big data technologies, build cloud-based solutions, and help deliver robust systems for customer-facing experiences.

Key Responsibilities

Design and develop data engineering solutions with Agile teams
Use Java, Scala, Python with RDBMS and NoSQL databases
Build and integrate cloud-based data warehousing with Redshift and Snowflake
Perform unit tests and code reviews to ensure performance and quality
Collaborate with digital product managers to deliver robust cloud-based experiences

Technical Overview

The role spans full-stack development and cloud data warehousing, using technologies such as Java, Scala, Python, NoSQL databases, Redshift, and Snowflake. It also emphasizes distributed data/computing (Kafka, Spark, Hadoop ecosystem), real-time streaming, UNIX/Linux and shell scripting, and strong engineering practices (unit tests, code reviews, performance tuning).

Ideal Candidate

The ideal candidate is a mid-level Data Engineer with a Bachelor's degree and 1.5+ years of application development experience plus 1+ year in big data technologies. They have hands-on experience with Python/Java/Scala and cloud data warehousing such as Redshift and Snowflake, along with distributed data tooling (e.g., Kafka, Spark, Hadoop) and real-time/streaming fundamentals.

Must-Have Skills

Bachelor's DegreeAt least 1.5 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologiesunit testscode reviews

Nice-to-Have Skills

3+ years of experience in application development including PythonSQLScalaor Java1+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)2+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)1+ years experience working on real-time data and streaming applications1+ years experience with NoSQL implementation (MongoCassandra)1+ years of data warehousing experience (Redshift or Snowflake)2+ years experience with UNIX/Linux including basic commands and shell scripting1+ years of experience with Agile engineering practices

Tools & Platforms

JavaScalaPythonRedshiftSnowflakeAmazon Web ServicesAWSMicrosoft AzureGoogle CloudOpen Source RDBMSNoSQL databasesMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLMongoCassandraUNIX/LinuxAgileAgile teams

Required Skills

application developmentJavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakebig data technologiesMapReduceHadoopHiveEMRKafkaSparkreal-time datastreaming applicationsMongoCassandraUNIX/Linuxshell scriptingAgileunit testscode reviews

Hard Skills

full-stack development tools and technologiesapplication developmentprogramming languages like Javaprogramming languages like Scalaprogramming languages like PythonOpen Source RDBMSNoSQL databasescloud based data warehousing services such as Redshiftcloud based data warehousing services such as Snowflakedistributed microservicesmachine learningunit testscode reviewsperformance tuningbig data technologiesDistributed data/computing toolsMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLreal-time data and streaming applicationsNoSQL implementationMongoCassandradata warehousing experienceUNIX/Linux including basic commands and shell scriptingAgile engineering practicesAgile teamsAgile methodologiescloud-based solutionsmentoring other members of the engineering community

Soft Skills

collaborate with Agile teamsfast-pacedcollaborativeinclusiveand iterative delivery environmentmentoringshare passion for learning new technologiescommunication with digital product managersteamworkproblem-solvingcode rigor and quality focus

Industry & Role

Industry Banking

Job Function Build and operate cloud-based data platforms and services using big data and distributed computing technologies

Role Subtype Data Engineer

Tech Domains Amazon Web Services, Azure, Google Cloud Platform, Python, Java, SQL / PostgreSQL, Workday, Linux

Clearance & Visa

Visa Sponsorship No

Keywords for Your Resume

Data Engineerdata engineerapplication developmentJavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeAWSAmazon Web ServicesMicrosoft AzureGoogle Cloudbig data technologiesMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLreal-time datastreaming applicationsMongoCassandraUNIX/Linuxshell scriptingAgile engineering practicesunit testscode reviewsunit testunit testingSQLApache Kafka

Deal Breakers

Bachelor's Degree, At least 1.5 years of experience in application development (internship does not apply), At least 1 year of experience in big data technologies, No immigration sponsorship / no offer of immigration related support

Apply for this Position →

Get matched to jobs like this

Luna finds roles that fit your skills and career goals — no endless scrolling required.

Create a Free Profile