Bigdata Engineer/Developer

Spark, Hive
Contract W2, 12 Months
Depends on Experience

Job Description

Role: Developer, Data Engineer

Location: Irving, TX

Duration: 12+ months



  • Analyze and understand  data sources & APIs
    • Design and Develop methods to connect & collect data from different data sources
    • Design and Develop methods to filter/cleanse the data
    • Design and Develop SQL , Hivequeries, APIsto extract data from the store
    • Work closely with data Scientists to ensure the source data is aggregated and cleansed
    • Work with product managers to understand the business objectives
    • Work with cloud and data architects to define robust architecture in cloud setup pipelines and work flows
    • Work with DevOps to build automated data pipelines

    Total Experience Required        
    • 4 <years <10 of relevant experience
    • The candidate should have performed client facing roles and possess excellent communication skills
    Business Domain knowledge: Finance & banking systems, Fraud, Payments    

    Required Technical Skills
    • Big Data-Hadoop, NoSQL, Hive, Apache Spark
    • Python
    • Java & REST
    • GIT and Version Control
    Desirable Technical Skills
    • Familiarity with  HTTP and invoking web-APIs
    • Exposure to machine learning engineering
    • Exposure to NLP and text processing
    • Experience with pipelines, job scheduling and workflow management
    Personal Skills      
    Experienced in managing work with distributed teams
    • Experience working in SCRUM methodology
    • Proven sense of high accountability and self-drive to take on and see through big challenges
    • Confident, takes ownership, willingness to get the job done
    • Excellent verbal communications and cross group collaboration skills
Dice Id : objks001
Position Id : 6582424
Originally Posted : 3 months ago
Have a Job? Post it

Similar Positions

Big Data Engineer/Architect
  • Idexcel Inc.
  • Dallas, TX
SR BigData Developer
  • Object Technology Solutions, Inc.
  • Irving, TX
Bigdata Engineer
  • Sage IT Inc
  • Frisco, TX
Big Data - PySpark
  • Wipro Ltd.
  • Irving, TX
Senior Data Analyst
  • InfoVision, Inc.
  • Irving, TX
Big Data Senior Engineer
  • Talent Minds Network, Inc.
  • Addison, TX
Big Data Engineer
  • Sky Consulting Inc
  • Dallas, TX
Azure Data Engineer
  • Metafore Consulting Services
  • Dallas, TX
Data Engineer (Hadoop and Spark)
  • Photon Infotech
  • Irving, TX
  • iQuest Solutions Corp
  • Plano, TX
Hadoop/ BigData Specialist
  • AgreeYa Solutions
  • Plano, TX
Data Engineer
  • Matlen Silver
  • Dallas, TX
Data Engineer - Hadoop
  • Maveric NXT Inc
  • Dallas, TX
Sr. Data Engineer
  • Intelliswift Software Inc
  • Plano, TX