Overview
On Site
Depends on Experience
Contract - W2
Contract - 1 Year(s)
No Travel Required
Able to Provide Sponsorship
Skills
Hadoop
Green Plum
Hadoop ecosystem (HDFS
Hive
Spark
Kafka)
SLAs and regulatory standards.
Job Details
Job Title – Big Data Engineer
Location – NYC, NY-Onsite
Job Type/Duration – Contract
Job Description:
Mandatory Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive.
- Strong work experience - Agile environment preferred
- Data Engineer (Big Data – Hadoop, Green Plum, etc. , Data Owner)
- Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum.
- Ensures data quality, security, and compliance through governance frameworks.
- Implements orchestration, monitoring, and performance tuning for reliable, cost-efficient operations.
- Expertise in Hadoop ecosystem (HDFS, Hive, Spark, Kafka) and MPP databases like Greenplum for large-scale data processing and optimization.
- Collaborates with Data Owners and stakeholders to translate business rules into technical solutions.
- Delivers curated datasets, lineage, and documentation aligned with SLAs and regulatory standards.
- Subject matter expert having experience of interacting with client, understanding the requirement, and guiding the team.
- Documenting the requirements clearly with defined scope and must play a anchor role in setting the right expectations and delivering as per the schedule.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.