Bigdata Lead Developer

Amazon S3, Amazon Web Services, Apache Hive, Apache Kafka, Apache Hadoop, Apache Spark, Big data
Full Time
Depends on Experience

Job Description

We are in Critical need of Bigdata Lead Developer for Fulltime Hire - Remote 
Role : Bigdata Lead Developer
Location : Remote
Duration : FTE Hire
Job Description : 
  • Involved in the Study of the business logic and coordinate with the client to gather the requirements.
  • Experience with Hive, Nifi, Airflow, Snowflake and Kafka
  • Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
  • Experience in Unit testing, integration testing for Spark scripts
  • Scripting with Bash, CSH, Shell, or Python
  • Designing and implementing large-scale ingest systems in a Big Data environment
  • Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
  • Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
  • Developing custom solutions/code to ingest and exploit new and existing data sources
  • Working with Sponsor development teams to improve application performance
  • Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
  • Collaborating with team-mates, other service providers, vendors, and users to develop new and more efficient method
  • Experience with CI/CD pipelines, unit tests, integration, and regression testing
  • Significant experience with Airflow
  • Strong ability to manage competing priorities and communication to multiple stakeholders
Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development.
Dice Id : 10114879
Position Id : 7397659
Originally Posted : 3 months ago
Have a Job? Post it

Similar Positions

Lead Ab Initio/Big Data Developer
  • Digital Intelligence Systems, LLC
  • Reston, VA, USA
Bigdata Developer
  • Vedainfo Inc.
  • Bethesda, MD, USA
Big Data Developer (Initial Remote)
  • CA-One Tech Cloud Inc.
  • Sunnyvale, CA, USA
Data Warehouse / Big Data Lead
  • AEG Resource Consulting
  • St. Louis, MO, USA
Sr Bigdata/hadoop Developer with AWS
  • Synechron
  • Charlotte, NC, USA
Big Data Engineer/ Feature Lead
  • Bank Of America
  • Charlotte, NC, USA
ETL/PySpark/ Big data Developer
  • Amiga Informatics
  • Cary, NC, USA
PySpark/Bigdata Developer
  • Amiga Informatics
  • New York, NY, USA