Overview
On Site
$50 - $60
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
Databricks
apache
aws
data lake
azur
python
sql
Job Details
Job Title: Data Engineer with Databricks
Location: Jersey City/NJ-Onsite
Job Description:
We are looking for a skilled Data Engineer with strong hands-on experience in Databricks, Apache Spark, and data pipeline development. The ideal candidate will have a solid understanding of modern data engineering principles, distributed data processing, and cloud-based data solutions (preferably AWS or Azure).
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks and Spark.
- Build and optimize data models and transformations to support analytics and reporting requirements.
- Integrate data from multiple structured and unstructured sources into centralized data platforms.
- Collaborate with data scientists, analysts, and application teams to ensure reliable data delivery.
- Implement and maintain data quality checks, performance tuning, and error-handling mechanisms.
- Develop reusable components and automation scripts for data ingestion and transformation.
- Ensure adherence to data governance, security, and compliance standards.
Required Skills & Experience:
- 5-8 years of professional experience in Data Engineering.
- Strong proficiency with Databricks, Spark (PySpark/Scala), and SQL.
- Hands-on experience with AWS (Glue, EMR, S3, Lambda) or Azure Data Services.
- Experience with data lake, data warehouse, and ETL/ELT frameworks.
- Familiarity with CI/CD pipelines, version control (Git), and DevOps concepts.
- Strong problem-solving and debugging skills with an analytical mindset.
- Excellent communication and teamwork skills.
Nice to Have:
- Experience with Delta Lake, Airflow, or Kafka.
- Exposure to Python/Java for data integration or API development.
- Experience working in Agile/Scrum environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.