Overview
Remote
Depends on Experience
Contract - W2
Skills
ClickHouse
Collaborate
Data Pipeline
Druid
SDET
Scala
Terraform
big data
cloud infrastructure
code review
design patterns
experimentation
object oriented programming
performance
scalability
Java
Kotlin
AWS
Data Engineer
ETL Pipelines
ETL
Real- Time
batch processing
Job Details
Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing.
Must have skills:
- Spark, Scala, Spring/Springboot/Scala
- 3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on both
- Ad targeting business domain experience.
Responsibilities:
- Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
- Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
- Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
- Chip in ground-breaking innovation and apply the state-of-the-art technologies
- As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing.
- Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
Desired skills:
- Experience with processing large amount of data at petabyte level
- Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc.
- Experience with ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, etc.