Overview
On Site
Hybrid
$70 - $75
Contract - W2
No Travel Required
Able to Provide Sponsorship
Skills
BMC Control-M
Microsoft SQL Server
Microsoft Azure
Databricks
PySpark
Python
Relational Databases
Snow Flake Schema
SQL
Extract
Transform
Load
Data Modeling
Data Quality
Job Details
Work location: New York City, NY (Hybrid, 3 days in a week)
In-person Interview is required
Job Description:
Looking for skilled senior data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.
Core Competencies:
- Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
- Strong understanding of relational databases, ETL processes, and data modeling.
- Expertise in system design, architecture, and implementing robust data pipelines.
- Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
- Skilled in Agile methodologies, SDLC processes, and CI/CD pipelines.
- Effective communicator with the ability to collaborate with business analysts, users, and global teams.
Key Responsibilities:
- Overall 15+ years of IT experience is required
- Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
- Develop and optimize data models and schemas for efficient data integration and analysis.
- Lead application development involving Python, SQL, Snowflake, and Databricks platforms.
- Implement data validation procedures to maintain high data quality standards.
- Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
- Provide ongoing support, troubleshooting, and maintenance in production environments.
- Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
- Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).
Additional Skills & Experience:
- Strong problem-solving and analytical skills.
- Bonus: Hands-on experience with PySpark.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.