About this role
Data Engineer building scalable data infrastructure for Seller Partner Trust and Store Integrity Science, enabling ML model training and real-time inference across a large e-commerce platform.
Key Responsibilities
- Design, build, and maintain scalable data pipelines
- Develop and optimize ETL/ELT processes
- Implement data quality checks and monitoring
- Build infrastructure for model training pipelines
- Collaborate with scientists to productionize ML models
Technical Overview
Big data engineering stack on AWS: Redshift, S3, Glue, EMR, Kinesis; ETL/ELT pipelines, data modeling, and OLAP analytics; productionized ML workflows with cross-functional collaboration.
Ideal Candidate
The ideal candidate is a mid-level data engineer with 3+ years in data pipelines and BI analytics, strong SQL/Oracle, and hands-on experience with AWS data services to support ML-ready pipelines.
Must-Have Skills
3+ years of data engineering experience1+ years of developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes experience1+ years of developing and operating large-scale data structures for business intelligence analytics using OLAP technologies experience1+ years of developing and operating large-scale data structures for business intelligence analytics using data modeling experience1+ years of developing and operating large-scale data structures for business intelligence analytics using SQL experience1+ years of developing and operating large-scale data structures for business intelligence analytics using Oracle experienceExperience with data modelingwarehousing and building ETL pipelines
Nice-to-Have Skills
Experience with AWS technologies like RedshiftS3AWS GlueEMRKinesisFireHoseLambdaand IAM roles and permissionsExperience with non-relational databases / data stores (object storagedocument or key-value storesgraph databasescolumn-family databases)
Tools & Platforms
Amazon Web ServicesRedshiftS3AWS GlueEMRKinesisLambdaIAM
Required Skills
ETLELTdata pipelinesdata modelingdata warehousingSQLOracleAmazon Web ServicesRedshiftS3AWS GlueEMRKinesisFireHoseLambdaIAM roles
Hard Skills
ETLELTData pipelinesData modelingData warehousingSQLOracleAmazon Web ServicesRedshiftS3AWS GlueEMRKinesisFireHoseLambdaIAM rolesOracle
Soft Skills
communicationteam collaborationproblem-solvingattention to detail
Keywords for Your Resume
data engineerdata pipelinesetleltolapdata modelingdata warehousingsqloracleamazon web servicesaws redshifts3aws glueemrkinesisfirehoselambdaiamdata platformsml readinesscollaboration
Deal Breakers
Less than 3 years data engineering experience, Lack of SQL/Oracle experience, No AWS experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile