DATA ENGINEER

Location: Conshohocken, PA
Salary: Not Specified by Client
Description: Our client is currently seeking a DATA ENGINEER
Permanent Fulltime Opportunity, W2 Only
Conshohocken, PA

POSITION SUMMARY:

The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization's data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering.

Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization's data infrastructure, aligning with the company's commitment to excellence and innovation.

ESSENTIAL DUTIES:

Data Pipeline and Architecture

oDesign, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric.

oImplement ETL processes to ensure data accuracy and availability.

oOptimize and tune data workflows for performance and scalability.

Visualization and Guidance

oProvide guidance on visualization tools, focusing on Power BI.

oContribute to guidelines and standards for visualization techniques and analytic dashboards.

Monitoring and Troubleshooting

oMonitor and troubleshoot data pipeline issues, ensuring timely resolution.

Documentation and Best Practices

oDevelop and maintain documentation for data processes, architectures, and workflows.

oStay updated with the latest trends and best practices in data engineering and Microsoft Fabric.

Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization's success and efficiency.

QUALIFICATIONS:

Education & Experience:

Bachelor's in computer science, data engineering, statistics, mathematics, or related fields.

5 years in data visualization, data mining, and analysis using Power BI

Proven experience as a Data Engineer, with a focus on MS Tech stack; Microsoft Fabric preferred.

Ability to write complex SQL queries.

Experience with Azure DevOps Git for version control.

Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace.

Understanding of data governance and security best practices.

Tools & Systems:

Proficiency in programming languages such as Python, Java, or Scala.

Familiarity with cloud platforms such as Azure.

Experience with CI/CD pipelines and automation tools.

The role involves frequent use of standard office equipment, such as computers, phones,

and printers.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!