Pyspark Data Engineer

Data Engineer AWS & PySpark Location: Dallas, TX or Richmond, VA Client: Confidential Job Summary We are looking for an experienced Data Engineer with strong hands-on expertise in AWS and PySpark. The ideal candidate must have prior professional experience working with Banking domain and be capable of developing scalable data pipelines and data processing solutions in a cloud environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using PySpark and AWS. Develo

Experienced Senior Data Engineer to work on a focused migration project converting existing Scala-based Spark pipelines to PySpark and transitioning job workloads from classic Databricks clusters to Databricks Serverless compute. The ideal candidate has hands-on experience with both Scala and PySpark, deep knowledge of Azure Databricks, and a strong understanding of Serverless compute constraints and best practices. Key ResponsibilitiesReview and analyze existing Scala Spark jobs identify depe

Hi, We are currently looking for a PySpark Developer for a full-time opportunity in Irving, TX with one of our global clients. If you are interested, please reply with your updated resume and let me know a convenient time to discuss the opportunity. Job Title: PySpark Developer Experience: 8- 10 Years Location: Irving, TX- Hybrid Duration: Fulltime Role Overview: Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines and data transformation

Job Description : Experience with big data processing and distributed computing systems like Spark.Implement ETL pipelines and data transformation processes.Ensure data quality and integrity in all data processing workflows.Troubleshoot and resolve issues related to PySpark applications and workflows.Understand source, dependencies and data flow from converted PySpark code.Strong programming skills in Python and SQL.Experience with big data technologies like Hadoop, Hive, and Kafka.Understanding