Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
PySpark
Fabric
ETL
PYTHON
Dremio
Job Details
Title: Data Engineer with Fabric
Duration 12+ Months
Location Charlotte, NC
Key Responsibilities:
- Strong hands-on experience with PySpark and Fabric for data processing and transformation.
- Design, develop, and optimize ETL pipelines using PYTHON, PYSPARK, S3 and Dremio
- Working on ProfitView Modernization which requires Pyspark, Python, Dremio, ETL, Financial exp.
- Work with large-scale structured and unstructured data from various sources.
- Implement data ingestion, transformation, and loading processes into data lakes and data warehouses.
- Collaborate with BI developers, data analysts, and business stakeholders to understand data requirements.
- Ensure data quality, integrity, and governance across all data pipelines.
- Monitor and troubleshoot performance issues.
- Participate in code reviews, testing, and deployment processes.
- Document technical solutions, data flows, and architecture.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.