SummaryThe Data Ops Engineer is responsible for improving, modernizing, and supporting data ingestion operations with a focus on building reliable, scalable, and resilient data pipelines. This role drives enhancements to existing ingestion processes through automation, monitoring, containerization, data quality controls, and operational best practices to improve reliability, reduce manual intervention, and ensure continuity of data operations. The Data Ops Engineer monitors pipeline health, troubleshoots production data issues, supports workflow orchestration and deployment, and maintains operational documentation to ensure trusted, timely delivery of data for analytics, reporting, business operations, and machine learning initiatives.
Essential Duties and ResponsibilitiesThis list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.
- Design, operate, and maintain reliable batch and streaming data pipelines that support analytics, reporting, business operations, and machine learning.
- Modernize existing ingestion workflows by identifying opportunities to containerize solutions for scalability and resiliency.
- Monitor pipeline health, job performance, data freshness, data availability, and SLA adherence using observability, logging, and alerting tools.
- Troubleshoot production data incidents, identify root causes, coordinate remediation, and document preventive actions through runbooks and post-incident reviews.
- Implement data quality checks, schema validation, anomaly detection, and reconciliation processes to improve downstream dataset and dashboard reliability.
- Support orchestration, scheduling, deployment, and lifecycle management for data workflows using tools such as Azure Data Factory, Azure Synapse, Azure Databricks, cloud-native data services, or comparable platforms.
- Collaborate with data engineers, business stakeholders, product owners, data analysts, and data architects to understand requirements and resolve operational issues.
- Improve reliability, scalability, performance, and cost efficiency of data platforms, warehouses, lakes, and integration processes.
- Maintain documentation for data workflows, operational procedures, dependencies, lineage, ownership, escalation paths, and support processes.
- Establish or contribute to CI/CD, infrastructure-as-code, environment management, access controls, and governance practices for production data systems.
- Participate in on-call or production support rotations as needed to support timely response to critical data issues.
- Support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing performance evaluation.
- Maintain confidentiality of information processed & follow company policies and procedures.
QualificationsRequires five (5) to seven (7) years of data engineering, data operations, data platform operations, or related experience. Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent professional experience preferred. Experience leading teams and developing supervisory staff preferred.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
Other qualifications include:
- Strong SQL skills and experience working with relational databases, data warehouses, and lakehouse environments.
- Hands-on experience with ETL/ELT pipelines, workflow orchestration, data transformation, and production data operations.
- Working knowledge of Microsoft Azure or other cloud platforms, Linux or command-line tools, scripting languages such as Python or Bash, and version control systems such as Git.
- Familiarity with Azure tools and platforms such as Azure Databricks, Azure Data Factory, Azure Container Apps, Azure Synapse, Azure Event Hubs, and Service Bus.
- Experience supporting data pipelines, datasets, or platform operations used for AI and machine learning workloads, with an understanding of data quality, observability, governance, privacy, and responsible AI considerations.
- Understanding of monitoring, alerting, logging, incident response, root cause analysis, and operational runbook development.
- Experience with data quality, schema management, metadata, lineage, governance, security, and access-control concepts.
- Ability to analyze pipeline performance, optimize queries, manage dependencies, and improve cost-performance of data workloads.
- Clear communication skills for translating technical issues into business impact and coordinating with cross-functional teams.
- Strong problem-solving mindset, attention to detail, ownership, and comfort working in production environments.
- Pharmacy Benefit Management, healthcare industry knowledge, HIPAA, SOC2, or PBM/pharmacy data workflow experience preferred.
Language SkillsAbility to read, analyze, and interpret common scientific and technical journals, manuals, financial reports, and legal documents. Ability to prepare reports and correspondence. Ability to communicate effectively with vendors, clients, board members and/or other employees of the organization. Effective project management skills a must. Basic Microsoft Outlook, Project, Excel, Word and Power Point skills required with a basic knowledge and understanding of IT networking principles.
Physical DemandsThe physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. (The phrases "occasionally," "regularly," and "frequently" correspond to the following definitions: "Occasionally" means up to 1/3 of working time, "regularly" means between 1/3 and 2/3 of working time, and "frequently" means 2/3 and more working time.)
While performing the duties of this job, the employee is frequently required to sit; talk or hear; and use hands to handle, or touch objects or controls. The employee is regularly required to stand and walk. On occasion the incumbent may be required to stoop, bend or reach above the shoulders. The employee would rarely need to lift up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception, and ability to adjust focus.
Work EnvironmentThe position is a hybrid position with 2 - 3 days office presence in Milwaukee, WI required. The colleague may perform work-related travel on rare occasions (less than 10%) with an emphasis on travel for impact.
The above statement reflects the general details necessary to describe the principal functions of the occupations described and shall not be construed as a detailed description of all the work that may be inherent in the occupation.
EEO StatementThis company is an equal opportunity employers committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. The Company makes hiring decisions based solely on qualifications, merit, and business needs at the time.
Compensation details: 00 Yearly Salary
PIc17ba22675b3-4
.jpg?format=webp)
Never miss an opportunity! Create an alert based on the job you applied for.
