Big Data Developer

Big Data, hadoop, hive, Spark, HDFS
Full Time
$90,000 - $140,000
Work from home available Travel not required

Job Description

Job Title:- Big Data Developer

Job Location:- Irving, TX or Tampa, FL .

Job Description:

  • 5+ years working experience in data integration and pipeline development. 
  • 2+ years of experience with Cloud on data integration with Apache Spark, EMR, Glue or similar Data-lake technologies.    
  • Strong real-life experience in python development especially in pySpark in AWS Cloud environment. 
  • Design, develop test, deploy, maintain and improve data integration pipeline. 
  • Experience in Python and common python libraries.  
  • Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. 
  • Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and integration tools. 
  • Strong debugging skills required in Java Spark/Python/API Spark-Integration/Hadoop. 
  • Databricks or Apache Spark using Scala Experience is appreciated. Knowledge of analytical data processing and basic statistics is desirable.  

Programming Languages: Java, Python, Shell (Bash) script. 

Data-tools: Apache Spark, Impala, Hive, Hadoop. 

  

Responsibilities 

  • Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform. 
  • Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities. 
  • Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts. 
  • Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements. 
Dice Id : 10106048
Position Id : 6978589
Originally Posted : 6 months ago
Have a Job? Post it

Similar Positions

Big Data Engineer
  • NexGen IOT Solutions, LLC
  • Dallas, TX, USA
Big Data Engineer, Tech Lead
  • Syeta Inc
  • Irving, TX, USA
Bigdata + Spark Developer
  • Virtusa Corporation
  • Irving, TX, USA
Big Data Engineer
  • Macrosoft
  • Plano, TX, USA
Cloud Application Developer
  • LiveMindz
  • Dallas, TX, USA
Data scientist
  • Myriad Consulting Inc
  • Irving, TX, USA
Ab Initio Metadata Developer
  • Tech Mahindra (Americas) Inc.
  • Irving, TX, USA
Bigdata Engineer-FTE
  • Impetus
  • Dallas, TX, USA