Data Engineer

Role: Data Engineer Location: SF is 1st Choice from a location standpoint. Seattle/LA is 2nd Last option Remote. Full Time

Skill: Java, Scala or Python, Spark, Hive, Single Store, Airflow, and AWS WHAT YOU LL DO

• Contribute to a team of big data and backend engineers to deliver high value projects
• Build components of large-scale data platform for batch and real-time processing, and own features of big data applications to fit evolving business needs
• Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
• Balance architectural and design considerations such as performance, scalability, reusability and flexibility issues
• Advocate the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
• Collaborate with researchers to productize cutting edge innovations at scale
• Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment

Basic Qualifications

• Bachelors degree in Computer Science, Electronics Engineering, or related field
• 5+ years of professional programming in Java, Scala, Python, etc.
• 3+ years of big data development experience with technical stacks such as Spark, Hive, Single Store, Airflow, and AWS
• Strong knowledge of system / application design and architecture
• Experience building industry level high available and scalable service
• Experience with processing large amount of data at petabyte level
• Passionate about technologies, and openness to interdisciplinary work

Preferred Qualifications

• Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, etc.
• Experience with Grafana, Datadog.
• Experience in widely used Web framework (React.js, Vue.js, Angular, etc.) and good knowledge of Web stack HTML, CSS, Webpack
• Ads domain knowledge