Apply Now

Senior Data Engineer with Java, Apache Spark

Remote • Posted 11 hours ago • Updated 11 hours ago

Full Time

Remote

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

Data Domain
Real-time
Analytics
Reporting
Use Cases
Microservices
Amazon Lambda
Database
File Systems
Message Queues
Finance
Management
Code Coverage
Data Engineering
Java
Scala
Python
Apache Spark
Streaming
Apache Kafka
SQL
Data Modeling
Amazon Web Services
Terraform
Docker
Kubernetes
Continuous Delivery
GitLab
Continuous Integration
Jenkins
Cloud Computing
Data Warehouse
Amazon Redshift
Microsoft Azure

Summary

We are seeking a Senior Data Engineer to join a technology-driven organization operating in the financial data domain, building a production-grade analytics and data ingestion platform processing large-scale financial datasets. This role focuses on designing, building and operating large-scale data ingestion and analytics solutions for batch and real-time processing of financial data, supporting critical downstream analytics and reporting use cases. Responsibilities Design, develop and maintain Apache Spark batch pipelines and Kafka streaming solutions Build serverless microservices using AWS Lambda and Azure Functions Develop data ingestion connectors for databases, file systems, message queues and financial data feeds Write production-grade code in Java, Scala and Python Manage infrastructure using Terraform across multiple environments Containerize and deploy applications using Docker and Kubernetes (EKS/AKS) Implement and maintain CI/CD pipelines in GitLab CI Write and maintain unit and integration tests with high code coverage Monitor platform health and troubleshoot production issues in distributed systems Requirements 5+ years of experience in data engineering or backend platform development Proficiency in Java and/or Scala as primary languages with Python as secondary Expertise in Apache Spark including Spark SQL and Spark Streaming Skills in Apache Kafka and event-driven architectures Competency in SQL and data modeling Familiarity with AWS cloud services and serverless computing Nice to have Knowledge of Terraform for Infrastructure as Code Skills in Docker and Kubernetes (EKS/AKS) Familiarity with CI/CD pipelines such as GitLab CI, Jenkins or equivalent Background in cloud data warehouses such as Amazon Redshift Understanding of Microsoft Azure services and Azure-native tooling Knowledge of Iceberg, Hudi or Delta Lake

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10330481
Position Id: 2f7e6234d8e3750488f8e24a35fa6a53
Posted 11 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer

Remote

•

11d ago

Role:Senior Data Engineer Location: Remote Duration:6+ Month Contract Job Summary We are seeking a hands-on Senior Data Engineer with 5+ years of experience building and supporting enterprise-scale data platforms. The ideal candidate will have strong expertise in AWS, Python, SQL, ETL/ELT development, data integration, and modern data engineering practices. This role will be responsible for designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and busin

Easy Apply

Contract

Depends on Experience

Key Java AI Engineer

Remote

•

Today

We are seeking a Key Java AI Engineer to design and deliver AI-enabled solutions using Java technologies. In this role, you will lead the implementation of business-critical, AI-powered features while contributing across the entire AI Software Development Life Cycle, from solution design through deployment and continuous improvement. Responsibilities Design, build and deploy AI-enabled solutions using Java technologies Lead the implementation of business-critical features powered by AI Contribut

Full-time

Senior Data Engineer

Remote

•

Today

Who we are Samsara (NYSE: IOT) is the pioneer of the Connected Operations Cloud, which is a platform that enables organizations that depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At Samsara, we are helping improve the safety, efficiency and sustainability of the physical operations that power our global economy. Representing more than 40% of global GDP, these industries are the infrastructure of our planet, i

Full-time

USD 118,107.50 - 178,650.00 per year

Senior Data Engineer

Remote or Minnetonka, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Full-time

USD 91,700.00 - 163,700.00 per year

Search all similar jobs

Remote jobs at EPAM Systems