Senior Data Engineer

Title: Senior Data Engineer
Location: San Francisco, CA
Length: 1 year, can be extended

Must Have: Scala, Java + Spark (can strong Java with some Scala + Spark)
JD:

Data Engineer Responsibilities

1. System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.
2. Support code versioning and code deployments for Data Pipelines.
3. Ensure test coverage for unit testing and support integration and performance testing.
4. Contribute ideas to help ensure that required standards and processes are in place.
5. Research and evaluate current and upcoming technologies and frameworks.
6. Build data expertise and own data quality for your areas.

Minimum Qualifications

1. 2-5+ years of Scala, Java development experience.
2. 2+ years of SQL and NoSQL experience (handling structured and unstructured data).
3. 1+ years of extensive experience with Spark Processing engine.
4. 1+ years of experience with big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
5. 1+ years' experience with Data Modeling.
6. Experience analyzing data to Client opportunities and address gaps.
7. Experience working with cloud or on-prem Big Data platform (i.e. Netezza, Teradata, AWS Redshift, Google Big Query, Azure Data Warehouse, or similar)