Data Engineer

ADF, Analytical skill, Analytics, Apache Cassandra, Apache Flink, Apache HBase, Apache Hadoop, Apache Hive, Apache Kafka, Apache Pig, Apache Spark, Apache Sqoop, Apache Storm, Big data, Cloud, Communication skills, Cosmos, Data management, Data marts, Data modeling, Data processing, Data structure, Data warehouse, Database, HDFS, Java, Mapping, Microsoft Windows Azure, MongoDB, NoSQL, PL/SQL, PostgreSQL, Presentations, SQL Azure, Scala, Self motivated, Software, Software development, Storage, Streaming, Transact-SQL
Full Time
Depends on Experience

Job Description

More than 3+ years of experience in Big Data application development

o Hands-on experience with the Hadoop stack (Hadoop MR, Hdfs, Pig, Hive, Sqoop)

o Experienced in computation frameworks like Spark, Storm, Flink using Java/Scala

o Well versed with streaming data processing using Kafka, Spark Streaming, Storm etc.

o Experience in working on Big Data application in cloud environment using Azure

o Excellent knowledge of NoSQL platforms like Hbase, MongoDb, Cassandra etc.

o Good knowledge of database technology with hands on experience on databases such as Oracle, SQL Server etc

o Self-starter, with a keen interest in technology and highly motivated towards success

o Excellent oral and written communication, presentation, and analytical skills

o Demonstrated experience designing, implementing, and supporting enterprise-grade technical solutions in the cloud for meeting complex business data requirements.

o Experience with Databricks and using Spark for data processing.

o Experience with Azure Data Factory – ADF.

o Advanced experience with different query languages (i.e. T-SQL, PostgreSQL, PL-SQL).

o Experience designing and building data marts, warehouses, customer profile databases, etc.

o Experience with data modeling, table design, and mapping business needs to data structures.

o Experience with Azure Data Lake, Azure SQL Data Warehouse, and Cosmos DB are a plus.

o Experience with Data Management Gateway, Azure Storage Options, Stream Analytics, and Event Hubs is a plus.

o Experience with other cloud based big data architectures is a plu

Dice Id : 90565764
Position Id : 6929286
Originally Posted : 4 weeks ago
Have a Job? Post it

Similar Positions

Data Engineer
  • Amko Soft
  • Houston, TX, USA
Lead Big Data Engineer
  • Youth Power Technosoft LLC.
  • Houston, TX, USA
Data Engineer
  • Net2Source Inc.
  • Houston, TX, USA
Application Support Engineer - Data, SQL, Infrastructure
  • eXcell, a division of CompuCom Systems, Inc.
  • Houston, TX, USA
Data Engineer
  • Kforce Technology Staffing
  • Houston, TX, USA
Big Data Engineer
  • Kforce Technology Staffing
  • Houston, TX, USA
Data Engineer
  • Kforce Technology Staffing
  • Houston, TX, USA
Data Engineer/Developer
  • Kforce Technology Staffing
  • Houston, TX, USA
Big Data Engineer
  • Vaco Technology
  • Hunters Creek Village, TX, USA
Data Engineer - Contract to hire - Houston, TX
  • Vaco Technology
  • Houston, TX, USA