About this role
Senior Data Engineer at Walmart responsible for data strategy, data transformation and integration, data modeling, and governance to support data-driven decisions and analytics.
Key Responsibilities
- Data Strategy
- Data Source Identification
- Data Transformation and Integration
- Data Modeling
- Code Development and Testing
Technical Overview
Involves building ETL pipelines with Spark (Scala/Python), Kafka-based streaming, data modeling (Snowflake, Star Schema), and cloud-based data platforms across AWS/GCP/Azure; uses Tableau/Excel for analytics and Jenkins/Git for CI/CD.
Ideal Candidate
The ideal candidate is a senior data engineer with a master's or bachelor's in a data/CS field and 1-3 years of software engineering experience; strong with data pipelines, ETL, Spark, Kafka, SQL, and cloud platforms.
Must-Have Skills
Master's degree or the equivalent in Computer ScienceInformation TechnologyEngineeringBusiness Analytics or a related field plus 1 year of experience in software engineering or related experience OR Bachelor's degree or the equivalent in Computer ScienceInformation TechnologyEngineeringBusiness Analytics or a related field plus 3 years of experience in software engineering or related experienceExperience with ETL pipelinesSpark (Scala or Python)KafkaSQLand data modeling
Nice-to-Have Skills
Experience with cloud platforms (AWSGoogle Cloud PlatformMicrosoft Azure)CI/CD pipelinesJenkinsGitTableau
Tools & Platforms
JenkinsGitTableauExcelAWSGoogle Cloud PlatformMicrosoft AzureAirflowSAP BWUnix ShellSnowflakeSAP BW
Required Skills
Data EngineeringETLSparkKafkaSpark StreamingSQL ServerOracleTeradataSQLSpark SQLHiveTableauExcelJenkinsGitAWSGoogle Cloud PlatformMicrosoft AzureAirflowSAP BWUnix ShellScalaPythonSnowflakeStar SchemaData ModelingData WarehouseData MartData Governance
Hard Skills
Spark with Scala or PythonKafkaSpark Streaming or Structured StreamingSQL ServerOracleTeradataSQLSpark SQLHiveTableauExcelJenkinsGitAmazon Web ServicesGoogle Cloud PlatformMicrosoft AzureAirflowSAP BWUnix ShellScalaPythonSnowflakeStar SchemaData Modeling
Soft Skills
CommunicationCollaborationProblem solvingMentoringLeadershipCross-functional communication
Keywords for Your Resume
senior data engineerdata platformdata engineeringetlsparkscalapythonkafkaspark streamingsqlhivetableauexceljenkinsgitawsgoogle cloud platformmicrosoft azureairflowsap bwunix shellsnowflakestar schemadata modeling
Deal Breakers
Lack of experience with required data stack (Spark, Kafka), Lack of cloud experience, Lack of data modeling experience
Get matched to jobs like this
Luna finds roles that fit your skills and career goals — no endless scrolling required.
Create a Free Profile