Overview
Remote
65 - 75
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
Databricks
PySpark
python
Azure
Job Details
Greeting from Accionlabs;
Job Title: Senior Data Engineer with Databricks and PySpark
Location: Remote
Key Responsibilities
- Design and implement scalable data processing pipelines using Databricks and PySpark.
- Develop and optimize ETL workflows for ingestion, transformation, and storage of large datasets.
- Collaborate with data architects and analysts to ensure data models and transformations align with business goals.
- Troubleshoot performance bottlenecks in data processing and improve runtime efficiency.
- Ensure code quality, data integrity, and adherence to best practices for distributed data systems.
Required Skills
- Strong hands-on experience with Databricks and PySpark.
- Proven track record of building production-grade data pipelines in distributed environments.
- Deep understanding of data processing frameworks, job orchestration, and optimization techniques.
- Strong problem-solving skills and the ability to work independently in a fast-paced environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.