Data Engineer

Overview

On Site
USD65 - USD70
Contract - W2

Skills

Data Engineer

Job Details

job summary:

Responsibilities:


Provide scoping, estimating, planning, design, development, and support services to a project.


Identify and develop the Technical detail design document.


Work with developers and business areas to design, configure, deploy and maintain custom ETL Infrastructure to support project initiatives.


Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.


Document and present solution alternatives to clients, which support business processes and business objectives.





location: Charlotte, North Carolina

job type: Contract

salary: $65 - 70 per hour

work hours: 9am to 5pm

education: Bachelors



responsibilities:

Responsibilities:


Provide scoping, estimating, planning, design, development, and support services to a project.


Identify and develop the Technical detail design document.


Work with developers and business areas to design, configure, deploy and maintain custom ETL Infrastructure to support project initiatives.


Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.


Document and present solution alternatives to clients, which support business processes and business objectives.


Work with business analysts to understand and prioritize user requirements


Design, development, test, and implement application code


Follow proper software development lifecycle processes and standards


Quality Analysis of the products, responsible for the Defect tracking and Classification


Track progress and intervene as needed to eliminate barriers and ensure delivery.


Resolve or escalate problems and manage risk for both development and production support.


Maintain deep knowledge and awareness of technical & industry best practices and trends, especially in technology & methodologies.



Skills and Knowledge:


Mandatory Skills


At least 6+ years of Developer experience specifically focused on Data Engineering


Strong Hands-on experience in Data Engineering development using Python and Pyspark as an ETL tool


Hands-on experience in AWS services like Glue, RDS, S3, Step functions, Event Bridge, Lambda, MSK (Kafka), EKS etc.


Hands-on experience in Databases like Postgres, SQL Server, Oracle, Sybase


Hands-on experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions and triggers


Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).


Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins


Strong foundation and experience with data modeling, data warehousing, data mining, data analysis and data profiling.


Strong experience with Agile/SCRUM methodology


Good communication and inter-personal skills


Nice to have Skills


Knowledge in developing UNIX scripts


Working knowledge of ERWIN


Experience in Reporting tools like Tableau, Power BI is a plus


Experience in working with REST API's


Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.)


Experience in workload automation tools like Control-M, Autosys etc.


Working knowledge of Data Science concepts




qualifications:

1st - PySpark (needs to be very strong)


2nd - Python (does not have to be OOP but very strong advanced scripting)


3rd - AWS Services (Glue, Step Functions and S3 buckets) (Azure Datafactory is similar to AWS Glue)


4th - Complex SQL queries




Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.