About this role
This role involves designing and leading data engineering projects, focusing on big data technologies, cloud platforms, and scalable data solutions within a financial services environment.
Key Responsibilities
- Designing data pipelines
- Leading data engineering teams
- Implementing cloud-based data solutions
- Optimizing data processing performance
- Mentoring junior engineers
Technical Overview
The technical environment includes Java, Scala, Python, Hadoop, Kafka, Spark, cloud data warehouses like Redshift and Snowflake, and NoSQL databases, with a focus on distributed microservices and full-stack development.
Ideal Candidate
The ideal candidate is a senior data engineer with extensive experience in big data technologies, cloud platforms, and distributed systems. They possess strong leadership skills, mentoring abilities, and a passion for emerging data technologies.
Must-Have Skills
Bachelor's Degreeat least 6 years of application development experienceat least 2 years of big data technologies experience1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)
Nice-to-Have Skills
Master's Degree9+ years of application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)5+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobiMySQL)4+ years working on real-time data and streaming applications4+ years of NoSQL implementation (MongoCassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of UNIX/Linux experience including shell scripting2+ years of Agile practices
Tools & Platforms
RedshiftSnowflakeHadoopKafkaSparkMongoDBCassandraAWSMicrosoft AzureGoogle Cloud
Required Skills
JavaScalaPythonHadoopKafkaSparkRedshiftSnowflakeNoSQLUNIX/LinuxShell scriptingAgile
Hard Skills
JavaScalaPythonOpen Source RDBMSNoSQL databasesRedshiftSnowflakeMachine LearningDistributed MicroservicesFull Stack DevelopmentCloud ComputingAWSMicrosoft AzureGoogle CloudHadoopKafkaSparkMongoDBCassandraUNIX/LinuxShell scriptingAgile engineering practices
Soft Skills
collaborationleadershipmentoringproblem-solvinglearning agilityteamworkcommunication
Keywords for Your Resume
Data Engineerbig datamachine learningdistributed microservicesfull stack developmentJavaScalaPythonRedshiftSnowflakeHadoopKafkaSparkMongoDBCassandraAWSMicrosoft AzureGoogle CloudUnix/LinuxShell scriptingAgilecloud computing
Deal Breakers
Lack of experience with big data technologies, No cloud computing experience, No relevant degree, Less than 6 years of application development experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile