Overview
On Site
Depends on Experience
Contract - W2
Contract - Independent
Contract - 1 Year(s)
Skills
Attention To Detail
Collaboration
Data Analysis
Data Integration
Data Processing
Data Quality
Extract
Transform
Load
Management
Microsoft
PySpark
Python
Relational Databases
Reporting
SQL
Scripting
Workflow
Writing
Job Details
Job Description
- The Client seeking a skilled and detail-oriented Data Engineer to join our team in supporting PGIM.
- The ideal candidate will be responsible for developing, maintaining, and optimizing data pipelines, ensuring data quality, and driving automation across data processes.
Key Responsibilities:
- Develop, maintain, and optimize robust and scalable data pipelines to support various business functions.
- Work closely with stakeholders to understand data requirements and deliver reliable data solutions.
- Implement data quality checks and frameworks to ensure accuracy and consistency across datasets.
- Automate data workflows to streamline processes and reduce manual intervention.
- Troubleshoot and resolve issues in existing pipelines and proactively monitor system performance.
- Collaborate with cross-functional teams to support data analytics and reporting needs.
Required Skills:
- MS Fabric Experience in utilizing Microsoft Fabric for data integration and management.
- SQL Strong proficiency in writing complex queries, optimizing performance, and managing relational databases.
- Python Hands-on experience in data scripting, automation, and ETL processes.
- PySpark Notebooks Ability to develop and manage large-scale data processing using PySpark in notebook environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.