Search Jobs | Dice.com

Job Details

Skills

Big Data
Java
Python Spark
AWS

Summary

Title : Big Data Engineer

Location :: NYC, NY (Onsite)

Duration : Contract

Relocation is fine

Required Technical Skills

As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.

Required qualifications, capabilities, and skills

§ Formal training or certification on software engineering concepts and 5+ years applied experience
§ Extensive experience in managing the full lifecycle of data, from collection and storage to analysis and reporting.
§ Proficiency in one or more large-scale data processing distributions such as Java or Python Spark along with knowledge on Data Pipeline (DPL), Data Modeling, Data warehouse, Data Migration and so-on.
§ Hands-on practical experience in system design, application development, testing, and operational stability
§ Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
§ Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
§ Strong organizational, problem-solving, and critical thinking skills; Strong documentation skills
§ Proficiency in Python or Java and proficiency in Spark
§ Hands-on experience on AWS services and its components along with good understanding on Kubernetes. AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge.
§ Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, JSON-L
§ AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager

Preferred qualifications, capabilities, and skills

§ Familiarity with modern front-end technologies
§ Experience designing and building REST API services using Java
§ Exposure to cloud technologies - knowledge on Hybrid cloud architectures
§ DevOps: Linux Scripting, Jenkins, Git, CI/CD, JIRA, TDD skills
Proficient in Big Data application development skills as well as multiple design techniques Working proficiency in Big Data development toolset to design, develop, test, deploy, maintain and improve
Software Strong understanding of Agile methodologies with ability to work in at least one of the common frameworks Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test
Driven Development, Cloud Development, application resiliency and security Proficiency in one or more general purpose programming languages Working proficiency in a portion of software engineering disciplines and demonstrates understanding of overall software skills including business analysis, development, testing, deployment, maintenance and improvement of software

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10448332
Position Id: 9033242
Posted 5 days ago

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer

Remote or New York, New York

•

4d ago

Description The Senior Data Engineer will play a critical implementation role on the Data Engineering and Data Services team and be responsible for data pipeline solutions design and development, troubleshooting, and optimization tuning on the next generation data and analytics platform being developed with leading edge big data technologies in a highly secure cloud infrastructure. The Data Engineer will serve as a liaison to platform user groups ensuring successful implementation of capabilitie

Easy Apply

Contract

Depends on Experience

AWS Data Engineer

Hybrid in Newark, New Jersey

•

27d ago

Data Engineer - AWS Newark, NJ. 3 days /week hybrid work Final In person interview is required. W2 candidates are highly preferred . We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data eng

Easy Apply

Contract

Depends on Experience

Lead Data Engineer

New York, New York

•

Today

Location: New York City, NY Salary: $80.00 USD Hourly - $88.00 USD Hourly Description: Lead Data Engineer New York, NY (10001) 6+ months Contract to Perm About the Role We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud-native data platforms and pipelines. You will lead the development of robust data solutions, drive architectural decisions, and mentor engineers while ensuring reliability, security, and operational excellence. Responsibilities

Contract

USD 80.00 - 88.00 per hour

Senior Data Engineer

Hybrid in Newark, New Jersey

•

13d ago

Title: Senior Data Engineer Duration:12+ months Contract Location:Newark, NJ (Hybrid- 3 days onsite) Qualifications: Bachelor''s degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience8+ years of experience as Data Engineer on AWS Stack with experience on DevOps toolAWS Solutions Architect or AWS Developer Certification requiredSolid experience of AWS services such as CloudFormation, S3, Athena, Glue, Glue DataBrew, EMR/Spark, RDS, Redshift, Da

Easy Apply

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Big Data Engineer

Skills

Summary

Dice Job Match Score™

Similar Jobs

Big Data Engineer

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs