Sr. Data Engineer

Hiring a Senior Data Engineer for a Healthcare Technology client
100% Remote, EST/CST candidates preferred

Salary: $110,000-120,000 + yearly bonus, benefits, 401k

ENVIRONMENT:

• Data Modeling experience


• ETL pipelines


• Azure data factory


• SSIS experience


• Reporting data in the data mart


• Team Size: 2 other senior data engineers

OVERVIEW:

The Senior Data Engineer is primarily responsible for designing, building, and maintaining the infrastructure that supports data storage, flow, and retrieval. The Senior Data Engineer works with large data sets and develops data pipelines that move data from source systems to data warehouses and processing systems.

All activities must be in compliance with Equal Employment Opportunity laws, HIPAA, ERISA, and other regulations, as appropriate.

Functions:

• Work with business users, developers, and other stakeholders to determine and document the requirements of the data warehouse and data marts


• Design and develop data pipelines for transferring data between several data sources in an efficient manner


• Combine raw information from various sources and explore ways to enhance data quality and reliabilit


• Utilize analytical tools & programs, and collaborate with database developers and database administrators, working on several project


• Manage data flow in a large-scale production environment with multiple workloads with different requirement


• Enhance the automation of data flow pipelines and processes to reduce toil and improve performanc


• Develop and manage the data archiving processes based on different retention policie


• Build and operate data pipelines including ensuring uptime through monitoring, alerting, and proactive maintenance tasks


• Assist the rest of the data operation team on migration of data sources to PaaS and other modern data platforms


• Design and implement solutions to complex systemsTake part in triaging and troubleshooting issues impacting our services

Minimum Requirements

• 5+ years of experience as a SQL Server DBA or Database Developer


• 5+ years of experience developing ETLs using SQL Server based tools like SSIS and ADF


• 5+ years of exposure with modern cloud tools and services


• Familiarity with developing large-scale ETL pipelines performing incremental load


• Experience in migrating IaaS data sources and ETLs to PaaS services


• In-depth knowledge and experience in database and ETL performance tuning, monitoring, and alerting


• Participate in 24x7x365 on-call rotation and provide support during off-hours for production incidents


• Experience or willing to learn and use Azure DevOps pipelines for continuous deployments (CI/CD)