Data Engineer (consultant must be authorized to work in US without sponsorship now or in the future) - CTH ON W2 (no c2c,1099) - Posted by Tauqeer

Overview

Remote
Depends on Experience
Contract - W2
Contract - 24 Month(s)
No Travel Required

Skills

Scala
Python
Extract
Transform
Load
Big Data
Spark
AWS
S3
Lambda

Job Details

Notes:
Required Skills
Candidates must be very strong as a Data Enginer - Design, develop, and maintain scalable ETL pipelines Must be strong in Python and Scala and have work with Big Data Tools very good communication
Job Description

MAJOR DUTIES AND RESPONSIBILITIES

- Design, develop, and maintain scalable ETL pipelines to ensure data quality and availability

- Implement monitoring and alerting solutions to ensure data pipeline reliability and performance

- Develop and manage deployment pipelines to facilitate continuous integration and delivery of data engineering solutions

- Document and communicate data engineering processes and standards to business-intelligence, data, and analytics professionals with varied backgrounds Continuously evaluate and improve data engineering tools and approaches to enhance performance and efficiency

REQUIRED QUALIFICATIONS

- Expertise in data engineering languages such as Scala (preferred) or Java, with proficiency in Python

- Experience with BigData tools, particularly Spark, and familiarity with Hadoop ecosystems

- Proficiency in building and managing ETL pipelines

- Experience with cloud platforms like AWS, including services such as S3, Lambda, Redshift, and EMR

- Strong understanding of relational databases and SQL, and familiarity with NoSQL databases

- Knowledge of data architecture, data warehousing, and data marts

- Experience in implementing monitoring solutions and deployment pipelines for data applications

- Ability to work with distributed systems and manage data storage solutions Demonstrated ability and desire to continually expand skill set, and learn from and teach others

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.