Overview
On Site
Full Time
Skills
Cloud Computing
HDFS
Extract
Transform
Load
ELT
Unix
Shell Scripting
Replication
Python
Scratch
Data Engineering
Apache Hadoop
Big Data
Streaming
API
Query Optimization
Performance Tuning
Database Administration
RDBMS
Oracle
MySQL
SQL
NoSQL
Database
Apache Spark
Microsoft SQL Server
MongoDB
Amazon Web Services
Google Cloud Platform
Google Cloud
Pivotal
Cloud Foundry
Microservices
Apache Kafka
Agile
Privacy
Marketing
Job Details
Location: Chandler, AZ
Description: Our client is currently seeking a Data Engineer
Location(s) Approved: Chandler AZ or Irving TX
Top Skillset Requirements:
Deep understanding of Hadoop / Cloud platforms, HDFS, ETL/ELT process and Unix shell scripting.
Deep understanding of distributed systems (CAP theorem, partition and bucketing, replication memory layouts, consistency)
Python Experience
Building Microservices from scratch
Experience with Apache Kafka or Confluent Enterprise
Ability to work effectively, as well as independently, in a team environment
Toolbox Requirements:
6+ years of Data Engineering experience.
3+ years of experience working in Spark, Hadoop and Big Data experience
3+ years of experience working on Spark SQL, Streaming and data frame/dataset API experience
3+ years of experience working on Spark query tuning and performance optimization
3+ years of experience working with Relationship Database Management Systems (RDBMS) such as SQL Server, Oracle or MySQL
3+ years of experience with SQL & NOSQL database integration with Spark (MS SQL server and MongoDB)
3+ years of experience with Amazon Web Services (AWS), Google Cloud Platform (Google Cloud Platform) or Pivotal Cloud Foundry (PCF)
3+ years of microservices development experience
2+ years of experience with Apache Kafka or Confluent Enterprise
2+ years of Agile experience
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Description: Our client is currently seeking a Data Engineer
Location(s) Approved: Chandler AZ or Irving TX
Top Skillset Requirements:
Deep understanding of Hadoop / Cloud platforms, HDFS, ETL/ELT process and Unix shell scripting.
Deep understanding of distributed systems (CAP theorem, partition and bucketing, replication memory layouts, consistency)
Python Experience
Building Microservices from scratch
Experience with Apache Kafka or Confluent Enterprise
Ability to work effectively, as well as independently, in a team environment
Toolbox Requirements:
6+ years of Data Engineering experience.
3+ years of experience working in Spark, Hadoop and Big Data experience
3+ years of experience working on Spark SQL, Streaming and data frame/dataset API experience
3+ years of experience working on Spark query tuning and performance optimization
3+ years of experience working with Relationship Database Management Systems (RDBMS) such as SQL Server, Oracle or MySQL
3+ years of experience with SQL & NOSQL database integration with Spark (MS SQL server and MongoDB)
3+ years of experience with Amazon Web Services (AWS), Google Cloud Platform (Google Cloud Platform) or Pivotal Cloud Foundry (PCF)
3+ years of microservices development experience
2+ years of experience with Apache Kafka or Confluent Enterprise
2+ years of Agile experience
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.