Senior Data Engineer - Only W2 (Python, SQL Server, Snowflake, Azure Databricks, and PySpark)

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

Python
Databricks
Snowflake

Job Details

Role: Senior Data Engineer

Location: NYC, NY (Hybrid, 3 days in a week from office)

Duration: 6+ Months

Job Description:

  • Looking for skilled senior data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.

Core Competencies:

  • Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
  • Strong understanding of relational databases, ETL processes, and data modeling.
  • Expertise in system design, architecture, and implementing robust data pipelines.
  • Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
  • Skilled in Agile methodologies, SDLC processes, and CI/CD pipelines.
  • Effective communicator with the ability to collaborate with business analysts, users, and global teams.

Key Responsibilities:

  • Overall 15+ years of IT experience is required
  • Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
  • Develop and optimize data models and schemas for efficient data integration and analysis.
  • Lead application development involving Python, SQL, Snowflake, and Databricks platforms.
  • Implement data validation procedures to maintain high data quality standards.
  • Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
  • Provide ongoing support, troubleshooting, and maintenance in production environments.
  • Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
  • Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).

Additional Skills & Experience:

  • Strong problem-solving and analytical skills.
  • Bonus: Hands-on experience with PySpark.

Prajjwal Chouhan

Empower Professionals

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.