Developer-Level III HYBRID ALBANY NY

Hybrid in Albany, NY, US • Posted 7 hours ago • Updated 7 hours ago

Contract Corp To Corp

Contract Independent

Contract W2

No Travel Required

Hybrid

$60 - $65/hr

MSquare Systems Inc.

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

PySpark
Meta-data Management
Data Governance
Databricks
Git

Summary

Mandatory Qualifications:
 Level III- More than seven (7) years of experience working on complex projects
with 2 or more years in a leadership role as a Developer
 More than seven(7) years of experience in designing end-to-end architecture for an enterprise Data Integration hub for centralized data ingestion and
transformation for various ingestion patterns(batch and event-driven)
 More than (7) years proven experience with SQL/NoSQL databases, API
development (REST/SOAP), version control (Git), and building data integrations
between on-premises & cloud systems.

Desirable Qualifications:
 More than (7) years proven experience with standardizing Api
 consumption, error handling, re-tires, and throttling.
 More than (7) years of experience in managing schema evolution and
 backward compatibility supporting legacy transformations
 More than (7) years’ hands-on experience in designing and implementing
 data integration hub
 More than (7) years proven experience in complex API based workflows,
 data governance, metadata and lineage tooling
 More than (7) years of experience in integrating Informatica with
 Databricks as the hubs’ transformation and curation engine
 More than (7) years of experience in designing hub-based data
 publishing mechanisms for data warehouses and analytics
 More than (7) years proven experience with security standards (OAuth,
 SAML), data governance, performance tuning, and relevant cloud/integration
 certifications
 More than seven(7) years of experience in event streaming platforms and cloud integration architectures

Duties/Responsibilities:
 Design and Develop Service based data integration architectures.Build ELT
pipelines with Databricks using PySpark and Databricks SQL Implement batch
and incremental data loads, including CDC patterns.
 Create reusable, standardized integration patterns. Establish logical and physical
integration layers, curation and distribution.
 Working with cross-functional teams (developers, product managers, etc.) to
define integration requirements and ensure successful integration.
 Identifying and resolving integration related issues, optimizing performance, and ensuring data security.
 Creating and maintaining clear and comprehensive documentation for internal
users and stakeholders

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10312882
Position Id: 8887764
Posted 7 hours ago

Company Info

About MSquare Systems Inc.

M-Square is an award-winning Information Technology Company that helps businesses transform the way they analyze, operate, monitor, and optimize their processes to disclose the new opportunities for continuous improvement and higher operational efficiency. M-Square believes that every organization can achieve digital transformation and operational excellence. Through our services and solutions, we inspire our customers to take action and explore the advantages of Advance IT solutions and solve complex problems with top-notch experienced professionals, high added value, and competitive cost savings. We help them to run their efficient business.

Our continuous process improvement and strategic planning have helped us grow and sustain the relationship with our customers. We are committed to providing services in areas of Information Technology, Consulting and Training.

Engage with us to achieve a seamless process to renovate your high business growth.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.