Overview
On Site
$100000 - $140000
Full Time
No Travel Required
Skills
PySpark
pYTHON
ETL
data quality
Data Engineer
Job Details
Role :: Senior PySpark Data Engineer
Location :: Irving, TX
Type :: Fulltime
Job Description:-
As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing in Big Data environment using predominantly PySpark/Python. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems using PySpark.
Roles & Responsibilities:
- Design, develop, and maintain data solutions for data generation, collection, and processing using PySpark.
- Create data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.
- Collaborate with cross-functional teams to identify and resolve data-related issues.
- Stay updated with the latest advancements in data engineering and integrate innovative approaches for sustained competitive advantage.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.