Big Data Engineer

Overview

On Site
Full Time
Part Time
Accepts corp to corp applications
Contract - W2
Contract - Independent

Skills

Employment Authorization
Apache Hadoop
Data Science
Data Analysis
Data Governance
Privacy
Data Security
Python
Apache Spark
Apache Hive
Data Warehouse
Data Modeling
Visualization
Analytics
Tableau
R
Data Engineering
Microsoft Azure
Cloud Computing
Streaming
Apache Kafka
Java
Linux
SQL
Scripting Language
Positive Attitude
Computer Science
Mathematics
Extract
Transform
Load
Software Design
Datastage
IBM InfoSphere DataStage

Job Details

Hiring: W2 Candidates Only

Visa: Open to any visa type with valid work authorization in the USA

Responsibilities

Develop and maintain data pipelines using ETL processes

Take responsibility for Apache Hadoop development and implementation

Work closely with data science team to implement data analytics pipelines

Help define data governance policies and support data-versioning processes

Maintain security and data privacy, working closely with data protection officer

Analyze vast number of data stores to uncover insights

Required skills and qualifications

Experience with Python, Spark, and Hive

Understanding of data-warehousing and data-modeling techniques

Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)

Strong data engineering skills with Azure cloud platform

Experience with streaming frameworks such as Kafka

Knowledge of Core Java, Linux, SQL, and any scripting language

Good interpersonal skills and positive attitude

Preferred skills and qualifications

Degree in computer science, mathematics, or engineering

Expertise in ETL methodology for corporate-wide solution design using DataStage

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.