Data Engineer, PV Prime Video TV - Tech

Prime Video (PV) is hiring a Data Engineer to build and maintain scalable data infrastructure for Commerce Analytics. The role focuses on designing data pipelines and models for subscription, transaction, and device registration datasets that support reporting, analysis, machine learning, and ad-hoc requests.

• Design complex data pipelines and models powering subscription, transaction, and device registration datasets
• Deliver scalable data solutions on native AWS infrastructure
• Develop data quality validation frameworks and monitoring solutions ensuring data integrity and timeliness
• Build and optimize batch and near real-time processing workflows using Spark, Redshift, and Andes
• Create robust orchestration and monitoring for workflows with complex dependencies
• Collaborate with cross-functional teams to onboard new data sources

You will work in a large-scale data warehouse environment, building batch and near real-time processing workflows using Spark, Redshift, and Andes Data Lake on native AWS infrastructure. You will implement data quality validation, monitoring, and orchestration for workflows with complex dependencies, integrating multiple heterogeneous data sources.

The ideal candidate is a mid-level data engineer with 3+ years of data engineering experience in large-scale data warehouse environments. They have hands-on experience building scalable data pipelines and near real-time/batch workflows on AWS services such as Redshift, EMR/Spark, and Andes Data Lake, with strong data quality, monitoring, and orchestration practices.