Date Engineer/Data bricks/ AWS/ Pyspark /SQL

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 2 Year(s)
No Travel Required
Able to Provide Sponsorship

Skills

Python
Java
Spark
AWS.
Data bricks/ AWS/ Pyspark /SQL
Pyspark
Scala
SQL

Job Details

Writing clean, efficient, and maintainable code for data pipelines, data processing tasks, and data quality checks.Implementing unit tests and integration tests to ensure code quality and reliability.

Troubleshooting and resolving technical issues related to the data framework.
Staying abreast of the latest advancements in data engineering technologies and best practices.
To be successful in this role, you will need:

5+ years of experience in data engineering or a related field.
+2 years Framework experience
Proven experience in designing and developing scalable data frameworks using Python, Java, Spark, and Scala.
Excellent communication and collaboration skills.
A passion for data engineering and a commitment to continuous learning.
Experience in code review and documentation is a plus.
Experience with cloud platforms like AWS.
Familiarity with data governance and security principles.
Experience with DevOps practices and tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.