Overview
On Site
Up to $55
Contract - Independent
Contract - W2
Skills
Data Extraction
Data Lake
Data Integrity
NumPy
SQL
Python
Extract
Transform
Load
Scripting
Job Details
Job Overview:
We are seeking a skilled Python Developer with strong ETL and data manipulation experience. The ideal candidate will have a solid background in working with large datasets using Pandas, NumPy, and SQL, particularly in Data Lake environments. You will be responsible for building scalable data pipelines and ensuring data integrity through thorough testing and exception handling.Key Responsibilities:
- Develop efficient Python scripts for data extraction, transformation, and loading (ETL).
- Perform complex data manipulation and analysis using Pandas, NumPy, and SQL.
- Work with a variety of data sources including Excel, CSV, and plain text files from a Data Lake.
- Implement robust error handling and exception management in all scripts.
- Write and maintain unit tests and regression tests to validate data quality and ensure code stability.
- Collaborate with data engineers, data analysts, and business teams to understand requirements and deliver data solutions.
- Optimize and refactor existing code for performance and scalability improvements.
Required Skills:
- Strong Python programming experience.
- Proficiency in Pandas and NumPy.
- Solid understanding of SQL and ability to write complex queries.
- Experience working with large-scale data in Data Lake environments.
- Ability to parse and consolidate data from Excel, CSV, and plain text formats.
- Hands-on experience with unit testing, regression testing, and exception handling in Python.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.