Bigdata developer

Bigdata, Pyspark, Hadoop, AWS, ETL, Data warehousing
Full Time
$120,000 - $125,000
Work from home available

Job Description

Job Description
 
Base Location: Irving, TX
Designation: Pyspark Developer
 
Education: Minimum Bachelor’s degree in Computer Science, Engineering, Business Information
Systems, or related field. Masters in Computing related to Pyspark and distributed computing is a
major plus
 
Key Responsibilities:
        Develop Big Data applications using -Pyspark on Hadoop, Hive and/or Kafka, HBase, MongoDB
        Build Machine Learning models
        Deployment on Cloud platforms
 
Experience & Skillset
MUST-HAVE
        Total IT / development experience of minimum 4+ years of Big Data.
        Experience in -Pyspark developing Big Data applications on Hadoop, Hive and/or Kafka, HBase,
MongoDB
        Deep knowledge of Pyspark and libraries to develop and debug complex data engineering
challenges
        Experience in developing sustainable data driven solutions with current new generation data
technologies to drive our business and technology strategies
        Exposure in deploying on Cloud platforms
 
        Development experience on designing and developing Data Pipelines for Data Ingestion or
Transformation using -Pyspark
        Development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC),
Resource Management, Distributed Processing and RDBMS
        Developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, TDD, CI/CD,
Change Management to support DevOps
        Development experience with SQL and Shell Scripting experience
 
 
GOOD-TO-HAVE
Banking domain knowledge
Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning
models
Digital Marketing Machine Learning models and use cases
ETL / Data Warehousing and Data Modelling experience prior to Big Data experience
Deep knowledge on AWS stack for big data and machine learning

Dice Id : 91121733
Position Id : 7137108
Originally Posted : 4 months ago
Have a Job? Post it

Similar Positions

Big Data Engineer, Tech Lead
  • Syeta Inc
  • Irving, TX, USA
Big Data Engineer
  • Syeta Inc
  • Dallas, TX, USA
Big Data Engineer
  • Tech Mahindra (Americas) Inc.
  • Irving, TX, USA
Bigdata Engineer-FTE
  • Impetus
  • Dallas, TX, USA
Senior Manager, Data Engineering
  • Capital One
  • Plano, TX, USA
Data Modeler
  • Triveni IT
  • Irving, TX, USA
Systems Administrator - II
  • Judge Group, Inc.
  • Grand Prairie, TX, USA
Ab Initio Metadata Developer
  • Tech Mahindra (Americas) Inc.
  • Irving, TX, USA
Big Data Tester
  • Syeta Inc
  • Irving, TX, USA
Sr Ab Initio Developer
  • Virtusa Corporation
  • Irving, TX, USA