ETL IICS Developer

Overview

On Site
$45 - $50
Contract - Independent
Contract - W2
Contract - 24 Month(s)
No Travel Required
Able to Provide Sponsorship

Skills

ETL
IICS
SQL
Python
AWS
PySpark
Scripting

Job Details

Title: ETL IICS Developer Location: McLean, VA (Onsite 5 Days in a week) Duration: Long Term Contract

Job Description: Need mandatory : 1) ETL : _______yrs exp 2) IICS : _______yrs exp 3) SQL : _______yrs exp 4) Python / PySpark : ____ yrs 5) Shell scripting : ____________ yrs 6) AWS : ____ yrs
Job Summary
We are seeking a skilled ETL Developer to design, develop, and maintain robust data pipelines and integration solutions.
The ideal candidate will have a strong background in ETL/ELT processes using Informatica Intelligent Cloud Services (IICS), Python, and PySpark, coupled with proficiency in shell scripting, AWS services, and CI/CD practices.
This role involves collaborating with cross-functional teams to ensure efficient data flow and integration across various platforms.
Key Responsibilities
ETL/ELT Development: Design and implement scalable ETL/ELT pipelines using IICS, Python, and PySpark to process and transform large datasets from diverse sources.
Data Integration: Integrate data from multiple systems, ensuring data quality, consistency, and reliability throughout the data lifecycle.
Shell Scripting: Develop and maintain shell scripts to automate routine data processing tasks and support ETL workflows.
AWS Services: Utilize AWS services such as S3, Glue, Lambda, Redshift, and EMR to build and manage cloud-based data solutions.
CI/CD Implementation: Implement and manage CI/CD pipelines using tools like Jenkins or GitHub Actions to automate testing, deployment, and monitoring of data pipelines.
Collaboration: Work closely with data architects, analysts, and other stakeholders to gather requirements and deliver data solutions that meet business needs.
Performance Optimization: Monitor and optimize the performance of data pipelines and ETL processes to ensure efficiency and scalability.
Required Qualifications
Education: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Experience:
Proven experience in designing and developing ETL/ELT pipelines using IICS, Python, and PySpark.
Strong proficiency in shell scripting for automation of data processing tasks.
Hands-on experience with AWS services, including but not limited to S3, Glue, Lambda, Redshift, and EMR.
Familiarity with CI/CD tools such as Jenkins or GitHub Actions for automating data pipeline deployments.
Preferred Qualifications
Experience with additional AWS services like Athena, Step Functions, and CloudWatch.
Knowledge of containerization and orchestration tools such as Docker and Kubernetes.
Familiarity with data security and privacy best practices.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.