About this role
Lead data engineering work in Card Tech by designing and delivering distributed, cloud-based data solutions. Partner with Agile teams to build, test, and support data platforms using big data and modern streaming technologies.
Key Responsibilities
- Design and build data engineering solutions with cloud and big data technologies
- Develop and support distributed microservices and full-stack systems
- Implement unit tests and perform performance tuning
- Work with Redshift and Snowflake for data warehousing
- Collaborate with Agile teams and mentor engineers
Technical Overview
As a Lead Data Engineer, you’ll work across full-stack engineering tools while focusing on big data technologies, distributed microservices, and cloud data warehousing. The role emphasizes Python/Java/Scala, NoSQL databases, and AWS with Redshift and Snowflake, along with streaming and distributed frameworks such as Kafka and Spark, plus strong unit testing and performance tuning practices.
Ideal Candidate
The ideal candidate is a lead data engineer with 4+ years of application development experience and 2+ years working with big data technologies. They have at least 1 year of cloud computing experience (AWS, Microsoft Azure, or Google Cloud) and strong hands-on experience with modern data platforms such as Redshift and Snowflake, plus distributed/streaming tools like Kafka and Spark. They also demonstrate solid software practices through unit testing, performance tuning, and collaboration in Agile teams.
Must-Have Skills
Bachelor's DegreeAt least 4 years of experience in application development (Internship experience does not apply)At least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWSMicrosoft AzureGoogle Cloud)
Nice-to-Have Skills
7+ years of experience in application development including PythonSQLScalaor Java4+ years of experience with a public cloud (AWSMicrosoft AzureGoogle Cloud)4+ years experience with Distributed data/computing tools (MapReduceHadoopHiveEMRKafkaSparkGurobior MySQL)4+ year experience working on real-time data and streaming applications4+ years of experience with NoSQL implementation (MongoCassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with Agile engineering practices
Tools & Platforms
Amazon Web ServicesAWSRedshiftSnowflakeKafkaSparkHadoopHiveEMRMongoCassandraUNIX/Linuxshell scriptingMapReduceMySQL
Required Skills
Data engineeringbig data technologiesfull-stack developmentmachine learningdistributed microservicesJavaScalaPythonOpen Source RDBMSNoSQL databasesAWSRedshiftSnowflakeMapReduceHadoopHiveEMRKafkaSparkreal-time datastreaming applicationsMongoCassandraUNIX/Linuxshell scriptingAgileunit testsperformance tuning
Hard Skills
full-stack development tools and technologiesunit testsperformance tuningbig data technologiesmachine learningdistributed microservicescloud-based data warehousing servicesAmazon Web ServicesRedshiftSnowflakeJavaScalaPythonOpen Source RDBMSNoSQL databasesMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLreal-time datastreaming applicationsMongoCassandraUNIX/Linuxshell scriptingAgile engineering practicesdistributed data/computing tools
Soft Skills
collaborate with Agile teamsmentoring other members of the engineering communityexperimenting with and learning new technologiesparticipating in internal & external technology communitiescollaborate with digital product managersiterative delivery environment
Keywords for Your Resume
Lead Data Engineerdata engineerCard Techbig data technologiesdistributed microservicesmachine learningfull-stack developmentJavaScalaPythonOpen Source RDBMSNoSQL databasesAmazon Web ServicesAWSRedshiftSnowflakeMapReduceHadoopHiveEMRKafkaSparkGurobiMySQLreal-time datastreaming applicationsMongoCassandraUNIX/Linuxshell scriptingAgile engineering practicesunit tests
Deal Breakers
Must have Bachelor's Degree, At least 4 years of application development experience, At least 2 years of experience in big data technologies, At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud), No visa sponsorship / no immigration support
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile