Overview
Remote
Depends on Experience
Contract - Independent
Contract - W2
Contract - 6 Month(s)
Skills
Experience with Spark in data engineering roles
Strong understanding of distributed computing and Spark UI for troubleshooting
Proficient in Scala and Java.
Familiarity with Zone-based/Medallion architecture and Delta/Parquet file formats
Experience with Azure Synapse.
Hands-on experience with GitHub
Azure Repos and build tools like Maven.
Job Details
Baer is looking for Lead Scala Development Consultant for a 6 month remote project
Title: Lead Scala Development Consultant
Location: Remote (Must be based in US)
Duration: 6 months
Rate: All-Inclusive
Alignment: W2 or C2C
Description:
- Lead data discovery and analysis efforts to establish data contracts from various source systems.
- Develop and enhance data pipelines using Scala, SQL, and Azure Synapse Pipelines.
- Monitor, support, and maintain data pipelines for ingestion and transformation using Scala and SQL on Spark.
- Troubleshoot and resolve pipeline errors and performance issues.
- Identify and address data discrepancies and inconsistencies.
- Translate technical details into understandable insights for non-technical stakeholders.
- Use GitHub for source and version control of code/configuration artifacts.
- Deploy code using GitHub Workflows/Actions.
Requirements:
- 7+ years of experience with Spark in data engineering roles.
- Strong understanding of distributed computing and Spark UI for troubleshooting.
- Proficient in Scala and Java.
- Familiarity with Zone-based/Medallion architecture and Delta/Parquet file formats.
- Experience with Azure Synapse.
- Hands-on experience with GitHub, Azure Repos, and build tools like Maven.
- Strong analytical, problem-solving, and communication skills.
Company Overview:
Baer provides best-in-class engagement experiences for our consultants. Our job requirements are carefully vetted and are typically associated with pivotal programs offering tremendous opportunities to expand your skills leveraging the latest solutions.
Baer is an equal opportunity employer including disability/veteran.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.