Our client is looking for a talented, passionate, experienced Senior/Lead Data Engineer to build our next-generation Reporting Data Processing platform which will offer accurate, reliable, and fast data for our customers.
What you will be doing
You will be responsible for Architecting, Building, and Testing our scalable high performance Data processing solution to support Reporting needs.
You will be taking the lead role to build the next generation Reporting and Analytics platform.
The main focus of this position is on Big Data technology, but also needs to extend responsibilities to Backend Scala programming and API implementation.
What we are looking for
Master degree in Computer Science major preferred or equivalent work experience.
Strong core Scala/Java programming skills are required.
Minimum of 5 years working experience in Spark or Big Data processing platform in high volume and low latency environment.
Minimum of 3 years experience leading small to big projects
Experience in implementing big data pipelines
Experience in designing concurrent and scalable applications
Good understanding of python
Knowledge of using cloud computing, experience of AWS is a plus
Knowledge and experience of developing on Druid is a huge plus.
Proficiency in working and developing on Linux.
Proficiency in using relational databases and writing SQL.
Experience with automated testing (TDD, Mocking, Unit/Functional/Integration)
Experience with build and continuous integration tools like SBT, Maven, Git, Jenkins, Jira, Confluence, etc.
Great interpersonal, written and verbal communication skills; including the ability to create technical specifications, debate technical tradeoffs, and explain technical concepts to business users.