Senior Data Engineering Specialist (Must Have - Scala Coding | Spark | Snowflake) | Contract | New York, NY (Onsite)
Job Title: Senior Data Engineering Specialist (Must Have - Scala Coding | Spark | Snowflake)
Location: New York, NY (Onsite) - Local or Near by candidates Only
Employment Type: Contract
In -Person Interview Must (Final Round)
Job Summary
We are seeking an experienced Senior Data Engineering Specialist with strong expertise in Scala, Apache Spark, Snowflake, and modern cloud-based data platforms. The ideal candidate will have extensive hands-on experience developing enterprise-scale data pipelines, implementing data models, optimizing large-scale data processing solutions, and supporting cloud migration initiatives.
This role requires strong coding expertise in Scala and Spark, along with experience designing and implementing scalable data solutions using Snowflake and Databricks technologies.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Scala and Apache Spark.
Build and optimize enterprise data processing frameworks for structured, semi-structured, and unstructured data.
Develop and maintain Snowflake-based data warehouse solutions and data models.
Implement data migration and modernization initiatives from legacy platforms to cloud-based architectures.
Create efficient SQL, PL/SQL, and Python-based data transformation solutions.
Develop Spark applications with a focus on performance tuning, scalability, and reliability.
Collaborate with cross-functional teams to support analytics, reporting, and machine learning initiatives.
Implement data quality, reconciliation, validation, and governance processes.
Develop CI/CD deployment pipelines and automated testing frameworks.
Support operational monitoring, troubleshooting, and continuous improvement of data platforms.
Required Skills
8+ years of Data Engineering experience.
5+ years of hands-on Scala development experience.
Strong expertise with Apache Spark, Spark SQL, DataFrames, joins, partitioning, and performance tuning.
Experience with Snowflake architecture, schema design, and data modeling.
Experience with Databricks and cloud-based data engineering platforms.
Strong SQL and PL/SQL development skills.
Experience building ETL and ELT pipelines.
Knowledge of distributed systems and large-scale data processing.
Experience with Data Warehousing concepts and dimensional modeling.
Experience working with Azure cloud services and storage solutions.
Preferred Skills
Snowflake REST API experience.
Apache Airflow.
Python scripting.
Delta Lake.
Unity Catalog.
GitHub Actions and CI/CD automation.
ScalaTest or automated testing frameworks.
Informatica or Talend ETL.
Data Governance and Data Quality frameworks.
Financial Services domain experience.
Required Experience
8+ years of overall Data Engineering experience.
5+ years of Scala and Apache Spark development.
3+ years of Snowflake experience.
3+ years of Databricks experience.
Proven experience delivering enterprise-scale cloud migration and modernization projects.
Never miss an opportunity! Create an alert based on the job you applied for.