Overview
Skills
Job Details
Key Responsibilities:
Design and develop scalable data pipelines for large-scale processing and transformation.
Integrate structured and unstructured data sources from various systems.
Build, manage, and optimize data architectures to support business intelligence and analytics.
Develop frameworks for data transformation, metadata management, dependencies, and workload orchestration.
Collaborate with analysts, data scientists, and product teams to deliver timely and accurate data solutions.
Required Skills & Experience:
Proven experience in a Data Engineer role, ideally supporting enterprise-grade platforms.
Strong SQL skills and working knowledge of relational databases and modern database technologies.
Hands-on experience with big data tools, including:
Hadoop, Spark, PySpark, Kafka
Proficiency in scripting and programming using Python and/or Java.
Familiarity with stream processing frameworks such as Apache Storm, Spark Streaming, etc.
Experience with workflow orchestration tools such as Apache Airflow, Luigi, etc.
Ability to build and support data transformation pipelines and metadata-driven solutions.
Preferred Qualifications:
Previous experience working on Walmart's internal data platforms or proprietary systems.
Familiarity with Walmart's tech stack, data ingestion processes, and governance standards.
Strong analytical skills with attention to performance optimization and data quality.
Effective communication and ability to work in fast-paced team environments.
Why Join?
Work on cutting-edge data infrastructure and analytics projects
Leverage your Walmart experience to make an immediate impact
Collaborate with an experienced, tech-savvy team
Competitive rate and long-term potential