Overview
On Site
DOE
Contract - W2
Skills
Data Engineering
Real-time
Batch Processing
Data Flow
Reporting
Media
Extract
Transform
Load
Data Quality
Professional Development
Apache Kafka
Apache Spark
Scala
Amazon Web Services
Cloud Computing
Amazon S3
Amazon EC2
Electronic Health Record (EHR)
Git
Version Control
Streaming
Big Data
Cloud Security
Job Details
Job Summary We are seeking a skilled Scala Developer to design and maintain scalable data pipelines for real-time and batch processing. This role involves working with streaming technologies, cloud platforms, and big data frameworks to ensure efficient data ingestion, transformation, and delivery. The ideal candidate will have hands-on experience with Scala and familiarity with modern data engineering tools. Key Responsibilities Develop and maintain data pipelines for real-time and hourly batch processing. Support scalable data flows for internal and external stakeholders, including reporting teams and media partners. Implement new data exports and update business logic for various feeds. Contribute to the development of billion-scale streaming data pipeline infrastructure. Ensure data quality and integrity throughout ingestion and processing. Required Qualifications Professional development experience with Scala. Practical knowledge of Apache Kafka for data streaming. Familiarity with Spark Structured Streaming (in Scala). Understanding of AWS cloud technologies (S3, Athena, EC2, IAM, EMR). Experience with Git for version control. Preferred Qualifications Experience working on large-scale data streaming projects. Knowledge of additional big data frameworks and cloud security best practices. Education: Bachelors Degree
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.