Senior Data Engineer (PySpark, Spark, Python)//12+ Years exp

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Proficiency in AWS cloud services for data engineering (e.g.
S3
EMR
EKS
Glue
Lambda).

Job Details

Senior Data Engineer (PySpark, Spark, Python)//12+ Years exp

Location- Irvine,CA

Duration: Long term

JD-

Technical Expertise:

    • Strong hands-on experience with PySpark, Spark, Python, and SQL.
    • Proficiency in AWS cloud services for data engineering (e.g., S3, EMR, EKS, Glue, Lambda).
    • Experience with Databricks for scalable data processing and collaborative analytics.
    • Familiarity with Airflow for orchestration and DBT for transformation.
    • Experience with Kubernetes for container orchestration.
    • Version control using GitHub and CI/CD practices.
  • Professional Experience:
    • ~10 years of experience in software/data engineering
    • Proven track record of delivering data solutions in complex environments.
    • Experience working in client-facing roles and managing stakeholder expectations.
    • Experience in Agile/Scrum environments.
  • Soft Skills:
    • Excellent communication and interpersonal skills.
    • Strong problem-solving mindset and ability to work independently.
    • Calm and composed under pressure, with a solution-oriented approach.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.