Overview
Skills
Job Details
About the Role
Walmart is seeking a highly skilled Data Engineer to join our growing data and analytics team. In this role,
you will design, build, and optimize data pipelines and workflows that power insights across our
organization. You will work with cutting-edge technologies to ensure data is accessible, reliable, and
actionable for business decision-making.
Key Responsibilities
Develop and maintain scalable ETL/ELT pipelines using Apache Airflow, dbt, and PySpark.
Design and implement data models and transformations for analytics and reporting.
Work with BigQuery and other cloud-based data warehouses to manage large-scale datasets.
Optimize data workflows for performance and cost efficiency.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data
solutions.
Ensure data quality, governance, and compliance with security standards.
Required Skills & Qualifications
Strong proficiency in Python 3 for data engineering and automation tasks.
Hands-on experience with Apache Spark 3 and PySpark for distributed data processing.
Expertise in Apache Airflow for workflow orchestration.
Solid understanding of pandas for data manipulation and analysis.
Experience with dbt for data transformation and modeling.
Familiarity with BigQuery or similar cloud data warehouses.
Knowledge of SQL and performance tuning.
Strong problem-solving skills and ability to work in a fast-paced environment.
Preferred Qualifications
Experience with CI/CD for data pipelines.
Knowledge of data governance and security best practices.
Familiarity with cloud platforms (Google Cloud Platform, AWS, or Azure).
Excellent communication and collaboration skills.
Screening
- Coderbyte SQL & Python