Data Engineer - Big Data

hadoop, deployment, jenkins, bitbucket, java, data warehousing, golang, amazon web services, python, perl, hbase, azure, hive, open source, scala, sql, statistics, cassandra, docker, kafka, application development, oozie, big data, pig, database, gradle, red hat linux, mapreduce
Full Time
Depends on Experience
Travel required to 50%.

Job Description

IBM seeks a Data Engineer - Big Data.

Required Technical and Professional Expertise

  • At least 2 years relevant experience
  • Minimum 1 years of hands-on experience in Big Data Eco System (Hadoop, Hive, and MapReduce)
  • Minimum 1 year of hands-on experience in Spark core
  • Minimum 1 years of hands-on programming experience in core Python or Java
  • Minimum 1 year of hands-on experience in HBase or Cassandra

Preferred Technical and Professional Expertise

  • Minimum 1 year of hands-on experience with RDBMS, DW/DM, NoSQL databases
  • Minimum 1 year of hands-on experience with Pig, Yarn and Oozie
  • Minimum 1 year of hands-on experience with Spark SQL and Spark Streaming
  • Minimum 1 year of hands-on experience with Scala, C/C++, Perl, Kafka, or Golang
  • Minimum 1 year of hands-on experience with building Docker containers
  • Minimum 1 year of hands-on experience with CI/CD using tools such as Gradle or Jenkins or BitBucket"
  • Minimum 1 year of hands-on experience with Cloud Platforms (AWS, Google, Red Hat or Azure)

Your Role and Responsibilities
The position of the Data Engineer plays a key role in the development and deployment of innovative big data platforms for advanced analytics and data processing. The Data Engineer defines and builds the data pipelines that will enable faster, better, data-informed decision-making within the business. Develops applications on Big Data and Cognitive technologies including API development. Expected to have traditional Application Development background along with knowledge of Analytics libraries, open-source Natural Language Processing, statistical and big data computing libraries. Strong technical abilities to understand, design, write and debug complex code.

IBM's unparalleled ability to bring together deep business insight, advanced research, analytics, and technology enables IBM Global Business Services to help position its clients for the future. We leverage the proven roadmaps and frameworks that have been developed across 17 industries and the unique combination of skills and experiences of our teams in over 170 countries - unmatched capabilities. When you join IBM, you'll partner with our clients, and leverage these capabilities to deliver real business value.

As a member of the world's leading and largest consulting organization, you'll tap into resources that only a global leader like IBM can provide: access to a vast and diverse network of talented professionals; enjoy unparalleled career opportunities; be provided with ongoing training and education that you'll need to succeed; and work on some of the most interesting projects on the planet, helping everyone from organizations to local governments, work smarter.

Dice Id : 90833617
Position Id : IBM289896C
Originally Posted : 6 months ago
Have a Job? Post it

Similar Positions

Hadoop Developer
  • BigBevy Consulting
  • Baton Rouge, LA
Hadoop Developer
  • Cynet Systems
  • Baton Rouge, LA
Hadoop Developer
  • Brevco Services
  • Baton Rouge, LA
Data Architect
  • Nexsolv Inc
  • Baton Rouge, LA
BIGDATA DEVELOPER/ARCHITECT
  • Intone Networks Inc.
  • Monroe, LA
GCP Architect with Big Data / Big Query Migration
  • Yochana IT Solutions
  • Dallas Tx, TX
Data Engineer
  • PREDICTif Solutions
  • Houston, TX
Data Engineer
  • 3coast
  • Houston, TX
Data Analyst
  • Vinsari LLC
  • San Antonio, Tx, TX
Snowflake Data Architect
  • Boston Associate Software Systems
  • Houston, TX
Snowflake Data Architect
  • TITAN TECHNOLOGIES
  • Houston, TX
Role: Data Warehouse Analyst - Direct Client.
  • Infomerica, Inc
  • Houston, TX