Python Consultant

Overview

On Site
Depends on Experience
Full Time

Skills

ADF
Data Engineering
Data Flow
Data Integration
Data Integrity
Data Lake
Data Manipulation
Data Modeling
Data Processing
ELT
Cloud Storage
DevOps
Microsoft Azure
SQL
Python
Pentaho
Migration
Cloud Computing

Job Details

Hello,

I am having urgent req!!
Role - Python Consultant
Location - Newark, NJ(Onsite)
Job Type - FTE -- Only Available on Full Time
Exp: 8+
Skills : (Strong Python + SQL)

We re seeking a skilled Python Engineer to support the migration of legacy ETL pipelines built in Pentaho Data Integration (PDI/Spoon) to modern cloud-based solutions such as Azure Data Factory (ADF). This role involves translating transformation logic, validating data integrity, and collaborating with cross-functional teams to ensure a smooth transition.

Note : Mandatory Experience

  • NumPy, Pandas
  • Fact table, Dimension table, Star schema, Snowflake Schema
  • SQL - Hands On
  • Azure Cloud
  • ADF Advantage
Required Skills

Strong proficiency in Python for data manipulation and automation.

Hands-on experience with Pentaho Data Integration (PDI)

5 7 years of experience in data engineering or ETL development.

Solid understanding of ETL/ELT concepts, data warehousing, and data modeling.

Experience with SQL (joins, aggregations, subqueries).

Familiarity with Azure Data Factory, cloud storage (Blob, Data Lake), and DevOps tools.

Version control using Git or Azure DevOps.

Basic scripting in PowerShell or Shell is a plus.

Key Responsibilities

Analyze and document existing Pentaho ETL jobs, transformations, and data flows.

Translate Pentaho logic into Python scripts and/or ADF pipeline components.

Develop and maintain scalable Python-based data processing solutions.

Validate data accuracy post-migration using automated testing and SQL queries.

Collaborate with data engineers, architects, and QA teams to troubleshoot issues.

Create technical documentation and participate in knowledge transfer sessions.

Qualifications

Bachelor s degree in Computer Science, Engineering, or related field.

Prior experience in migration projects is highly desirable Soft Skills.

Detail-oriented with a meticulous approach to data validation.

Strong communication and documentation abilities.

Collaborative mindset with a proactive attitude.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.