Big Data Developer

API, Amazon Web Services, Apache Hadoop, Apache Hive, Apache Spark, Bash, Big data, Bitbucket, Cloud, Cloudera Impala, Data integration, Data processing, Database, Debugging, Documentation, EMR, Functional requirements, Git, Integration, Java, Jenkins, Process mapping, Python, QA, Query optimization, Requirements elicitation, Revision control, Scala, Scripting, Shell, Software development, Standard operating procedure, Statistics, Technical drafting, Test plans, Writing
Full Time
Depends on Experience

Job Description

Job Title:- Big Data Developer

Job Location:- Irving, TX or Tampa, FL .

Job Description:

  • 5+ years working experience in data integration and pipeline development. 
  • 2+ years of experience with Cloud on data integration with Apache Spark, EMR, Glue or similar Data-lake technologies.    
  • Strong real-life experience in python development especially in pySpark in AWS Cloud environment. 
  • Design, develop test, deploy, maintain and improve data integration pipeline. 
  • Experience in Python and common python libraries.  
  • Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. 
  • Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and integration tools. 
  • Strong debugging skills required in Java Spark/Python/API Spark-Integration/Hadoop. 
  • Databricks or Apache Spark using Scala Experience is appreciated. Knowledge of analytical data processing and basic statistics is desirable.  

Programming Languages: Java, Python, Shell (Bash) script. 

Data-tools: Apache Spark, Impala, Hive, Hadoop. 

Responsibilities 

  • Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform. 
  • Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities. 
  • Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts. 
  • Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements. 
Dice Id : 10106048
Position Id : 7277089
Originally Posted : 4 months ago
Have a Job? Post it

Similar Positions

Sr. Big Data Platform Developer
  • Mindlance
  • Tampa, FL, USA
Big Data Developer
  • Pinnacle Group
  • Tampa, FL, USA
Big Data Developer
  • Doran Jones
  • Tampa, FL, USA
Sr. Big Data Platform Developer
  • TSR Consulting Services, Inc.
  • Tampa, FL, USA
Big Data Developer
  • MATRIX Resources, Inc.
  • Tampa, FL, USA
BIG DATA MANAGEMENT & ANALYSIS - IV
  • Judge Group, Inc.
  • Temple Terrace, FL, USA
BIG DATA MANAGEMENT & ANALYSIS - IV
  • Judge Group, Inc.
  • Temple Terrace, FL, USA
Principal Big Data Engineer - Azure Databricks (REMOTE)
  • Randstad Technologies
  • Lakeland, FL, USA