Sr. Software Engineer (Data Engineer)

Overview

Hybrid

Depends on Experience

Contract - W2

Contract - Independent

Contract - 12 Month(s)

Skills

Azure Data Lake

Azure Synapse

Azure Databricks

Spark

Yaml

DataOps

MLOps

Job Details

JD:

We are seeking a Senior Software Engineer (Data Engineer) with strong expertise in Spark, Scala, and Azure Data Services. The ideal candidate will design, develop, and maintain large-scale data processing solutions while working with modern cloud and pipeline technologies.

Key Responsibilities:

Design, build, and optimize data pipelines using Apache Spark and Scala.
Develop and maintain EV2 Pipelines and Azure Fabric Semantic Models.
Implement and manage Azure Data Factory (ADF) pipelines for data ingestion, transformation, and orchestration.
Work with YAML configurations for deployment, pipeline setup, and infrastructure automation.
Utilize Azure services such as Azure Data Lake, Azure Synapse, Azure Databricks, and Azure Fabric.
Integrate and optimize SQL queries, stored procedures, and database performance.
Collaborate with cross-functional teams to design and deliver scalable, secure, and reliable data solutions.
Participate in Spark and Scala coding tests and ensure adherence to best coding practices.
Ensure compliance with Microsoft (MS) standards and best practices for cloud data engineering.

Required Technical Skills:

Strong programming skills in Scala and PySpark/Spark SQL.
Hands-on experience with Azure Data Factory (ADF), Azure Databricks, and Azure Fabric.
Knowledge of EV2 Pipelines, YAML scripting, and CI/CD deployment processes.
Solid understanding of Azure Data Lake, Azure Synapse Analytics, and Data Modeling concepts.
Proficiency in SQL and performance tuning.
Experience with Microsoft cloud ecosystem and recent MS project experience is a plus.
Familiarity with semantic model design in Microsoft Fabric or Power BI.

Preferred Qualifications:

Bachelor s or Master s degree in Computer Science, Information Systems, or a related field.
6+ years of experience in Data Engineering roles.
Experience working in an Agile/Scrum environment.
Strong analytical and problem-solving skills with attention to detail.

Nice to Have:

Exposure to Azure DevOps and Git for version control and CI/CD.
Experience in DataOps or MLOps pipelines.
Certification in Microsoft Azure Data Engineer or related domain.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.