Overview
Hybrid
$50+
Contract - W2
Skills
Amazon Redshift
Amazon Web Services
Apache Hive
Apache Kafka
Apache NiFi
Apache Oozie
Apache Spark
Cloud Computing
Java
Microsoft Azure
Netezza
NoSQL
Python
SQL
Scala
Service Level
Streaming
Teradata
Unit Testing
Data Quality
Data Warehouse
Data Modeling
Performance Testing
Job Details
Mandatory Skills: Either Java or Scala, SQL and NoSQL, Apache Spark, Cloud Platforms
Must have in recent project:
- Scala
- Apache Spark
- SQL and NoSQL
Data Engineer Responsibilities:
- System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.
- Support code versioning, and code deployments for Data Pipelines.
- Ensure test coverage for unit testing and support integration and performance testing.
- Contribute ideas to help ensure that required standards and processes are in place.
- Research and evaluate current and upcoming technologies and frameworks.
- Build data expertise and own data quality for your areas.
Minimum Qualifications:
- 2+ years of Java/Scala development experience.
- 2+ years of SQL and NoSQL experience (handling structured and unstructured data).
- 1+ years of extensive experience with Spark Processing engine.
- 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
- 1+ years experience with Data Modeling.
- Experience analyzing data to discover opportunities and address gaps.
- Experience working with cloud or on-prem Big Data platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)
- Nice to have but not mandatory
- Programming experience in Python
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.