Python ETl Developer

Role - Senior Python ETL Developer (AWS Glue)

Remote

Rate :Only $40/hr on C2C Max

Technology -Python packages to support ETL, for RBQM and within AWS, specifically with the Glue framework.

Job Description of Role* We are seeking a highly skilled Senior Python ETL Developer with 8+ years of experience to design and build scalable data transformation solutions. The role focuses on developing robust Python packages to support ETL pipelines, with a strong emphasis on the transformation layer for RBQM (Risk-Based Quality Management).

The ideal candidate will have deep expertise in AWS cloud services, particularly AWS Glue, and strong experience in modern data processing frameworks.

Educational Qualification*Bachelor’s Degree or higher in Information Systems, Computer Science, or equivalent experience.

Primary (Must have skills)*

• Strong emphasis on the transformation layer for RBQM (Risk-Based Quality Management).
• Deep expertise in AWS cloud services, particularly AWS Glue
• Strong experience in modern data processing frameworks.
• Experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps
• 8+ years of experience in Python development, with strong expertise in building ETL pipelines.

Hands-on experience with:

6+ years Polars, Pandas, and PySpark for data transformation

6+ years of AWS Cloud, specifically AWS Glue

Strong experience in:

5+ years Unit testing frameworks (Pytest / unittest)

5+ Years Mocking frameworks like Moto

Version control and CI/CD using GitHub workflows

Experience working with AI coding assistants or agents.

Solid understanding of data engineering best practices, performance tuning, and scalable architecture.

Strong problem-solving and analytical skills.C5

Key Responsibilities:

Design, develop, and maintain Python-based ETL frameworks and reusable packages.

Build and optimize data transformation pipelines using AWS Glue and PySpark.

Work extensively on data processing and transformation using Polars and Pandas.

Ensure code quality through unit testing frameworks such as Pytest/unittest.

Develop and maintain automated CI/CD pipelines using GitHub workflows.

Implement robust testing strategies using tools like Moto for AWS service mocking.

Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.

Leverage AI-assisted coding tools/agents to improve productivity and code quality.

Monitor, troubleshoot, and optimize ETL jobs for performance and reliability.

Soft skills/other skills - To be Evaluated by Hiring Manager (To define how this will be evaluated)    Communication Skills:

Communicate effectively with internal and customer stakeholders

Communication approach: verbal, emails and instant messages

Interpersonal Skills:

Strong interpersonal skills to build and maintain productive relationships with team members

Provide constructive feedback during code reviews and be open to receiving feedback on your own code.

Problem-Solving and Analytical Thinking:

Capability to troubleshoot and resolve issues efficiently.

Analytical mindset

Task/ Work Updates

Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps

Provides regular updates, proactive and due diligent to carry out responsibilities