Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
Amazon Web Services
Amazon Redshift
Big Data
Microsoft Azure
Java
Scala
Apache Spark
Python
SQL
Job Details
Title: Senior Data Engineer
Location: San Francisco, CA – 3 days a week in office is a must
Length: 1 year, can be extended
Must Have: Scala, Java + Spark ( can strong Java with some Scala + Spark)
JD:
Data Engineer Responsibilities
- System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.
- Support code versioning, and code deployments for Data Pipelines.
- Ensure test coverage for unit testing and support integration and performance testing.
- Contribute ideas to help ensure that required standards and processes are in place.
- Research and evaluate current and upcoming technologies and frameworks.
- Build data expertise and own data quality for your areas.
Minimum Qualifications
- 2-5+ years of Scala, Java development experience.
- 2+ years of SQL and NoSQL experience (handling structured and unstructured data).
- 1+ years of extensive experience with Spark Processing engine.
- 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
- 1+ years experience with Data Modeling.
- Experience analyzing data to discover opportunities and address gaps.
- Experience working with cloud or on-prem Big Data platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)
Proficient in Scala, Java, or Python( least preferred)
Note:
- The candidate must work from the office 3 days per week.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.