Overview
Skills
Job Details
Will be replacing a previous hire who was a recent graduate but had some professional Scala experience
Responsibilities:
Support scalable data pipelines that ingest, transform, and deliver company data to internal and external stakeholders, including multiple reporting teams and external media partners.
Develop and maintain data pipelines for real-time and batch processing (hourly).
Implement new data exports and update business logic for various data feeds.
Contribute to the development of billion-scale streaming data pipeline infrastructure.
Ensure data quality and integrity throughout the ingestion and processing lifecycle.
Must-haves:
Hands-on Scala experience
Understanding of AWS cloud technologies
Practical knowledge of Apache Kafka
Familiarity with Spark Structured Streaming (in Scala)
Experience with Git