Big Data Engineer with Java background | W-2 Only | 8-12 years of experience required

Location: Whippany, NJ Position Type: Contract / Full-Time (Hybrid) Work Mode: 2-3 days onsite per week

What You ll Do

• Build, deploy, and maintain large-scale distributed data processing systems and pipelines to support enterprise data needs.
• Design and lead end-to-end Big Data solutions: from ingestion, storage, processing to access; ensure scalability, reliability, and performance.
• Develop batch and streaming workflows using Spark, Hadoop, Kafka, HBase, Hive, Impala, and NoSQL databases.
• Monitor system health, analyze performance metrics, troubleshoot issues (including Cloudera/Hadoop logs), and effect cluster configuration and performance optimizations.
• Use AutoSys for job scheduling and monitoring; ensure jobs run reliably, manage failures, and automate recovery where possible.
• Enforce and implement data governance, data security, and data management best practices across the Big Data platform.

What You Bring

• Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
• 8-10 years of software development/data engineering experience working with large-scale distributed systems.
• Minimum 4 years leading Big Data solution designs and implementations in enterprise environments.
• Strong programming skills in Java, J2EE, Scala.
• Deep hands-on experience with Hadoop ecosystem: Spark, HDFS, YARN, Hive, Impala, Sqoop, HBase; Kafka; NoSQL DBs.
• Solid experience with SQL, ElasticSearch, Oracle, and relational/non-relational data stores.
• Proficient in using AutoSys (or similar) for job scheduling and monitoring.
• Strong troubleshooting skills performance tuning, logs analysis, cluster issues.
• Knowledge of data governance and Hadoop/Cloudera security best practices.
• Working experience with Linux, version control (Git), and CI/CD toolchains (Jenkins etc.).
  

Ideal Skills

• Familiarity with cloud-based Big Data / data lake architectures (AWS, Azure, or Google Cloud Platform).
• Experience with containerization / orchestration (Docker, Kubernetes) is a plus.
• Ability to mentor & guide junior engineers.
• Excellent communication skills, strong attention to detail, and ability to work cross-functionally.

Engagement Rules

• Contract Position (W2 only) No C2C, No Agencies.
• This is a senior-level role requiring 8+ years of professional experience in data engineering and financial services.
• Candidates must have verifiable project experience in big data and Java development.
• H1-B transfer available for the right candidate.
• Multi-year contract with annual extensions.
• Hybrid onsite role (Whippany, NJ).