🔗 Matching skills to job...
Role : Hadoop Data Engineer
Location : Scottsdale AZ (100%)
Hire Type : Contract
Key Responsibilities
Design, develop, and maintain scalable data processing applications using Java (8 or above) and Spring Boot.
Build and optimize big data pipelines using Spark and Scala for large-scale data processing.
Develop and consume RESTful web services for data integration and platform interoperability.
Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.
Write optimized Hive queries and SQL, focusing on performance and scalability.
Work on distributed data platforms leveraging Hadoop ecosystem components.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Ensure code quality through reviews, version control, and CI/CD best practices.
Troubleshoot and resolve performance, scalability, and data reliability issues.
Required Skills & Qualifications
8 12 years of hands-on experience in Java (version 8 or above).
Strong expertise in Spring Boot framework.
Excellent proficiency in Apache Spark and Scala.
Strong experience with Hive, SQL optimization, Hadoop, and Kafka.
Solid understanding of RESTful web services.
Experience with version control systems such as Git / GitLab.
Hands-on experience with build tools like Maven and/or Gradle.
Strong understanding of distributed systems and big data architecture.
Experience with streaming frameworks such as Spark Streaming and Kafka Streams.
Experience working in large-scale enterprise data platforms.
Exposure to performance tuning and capacity planning for big data systems.
Knowledge of DevOps or CI/CD pipelines is a plus.
Never miss an opportunity! Create an alert based on the job you applied for.Scottsdale, Arizona
•
9d ago
Role : Hadoop Data Engineer Location : Scottsdale AZ (100%) JD : Strong Experience in Scala, Spark, Hive SQl, Hadoop and KafkaProficiency in Hive and SQL optimization.Understanding of distributed systems and big data architecture.Knowledge of streaming frameworks (Spark Streaming, Kafka Streams).Familiarity with data partitioning, compression, and serialization formats
Easy Apply
Contract, Third Party
$60 - $70
Hybrid in Scottsdale, Arizona
•
2d ago
JD : Strong Experience in Scala, Spark, Hive SQl, Hadoop and Kafka Proficiency in Hive and SQL optimization. Understanding of distributed systems and big data architecture. Knowledge of streaming frameworks (Spark Streaming, Kafka Streams). Familiarity with data partitioning, compression, and serialization formats
Easy Apply
Full-time
$40,000 - $50,000
Phoenix, Arizona
•
3d ago
We are seeking a highly skilled Big Data Engineer to join our data engineering team for a leading banking client. The ideal candidate will have strong experience in building and managing large-scale data pipelines, implementing data processing frameworks, and working with banking or financial datasets. Key Responsibilities Design, develop, and maintain scalable Big Data pipelinesand ETL workflows using tools such as Spark, Hadoop, Kafka, and Airflow.Collaborate with data scientists, analysts, an
Easy Apply
Contract, Third Party
Depends on Experience
Phoenix, Arizona
•
2d ago
Java, spring boot- Experience with design and coding in Java, SpringBoot, Kafka, Junits, Mockito, Integration testing, Sonar Cube , log4j, Gradle & maven, Git, Unix & shell scripting, RDBMS, SQL, NoSQL data bases, REST, Cloud & related experience in docker, kubernetes, Helm config, Dynatrace, performance tuning for sub second response applications.
Easy Apply
Contract
Depends on Experience
