SeniorData Engineer

Overview

Remote
$80 - $85
Contract - W2
Contract - 12 Month(s)

Skills

Databricks
Medallion
Azure
data pipelines

Job Details

Immediate need for a talented Senior Data Engineer. This is a 12+ months contract opportunity with long-term potential and is located in San Diego, CA (Remote). Please review the job description below and contact me ASAP if you are interested.

Job ID: 25-91997

Pay Range: $80 - $85/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

  • Design, develop, and optimize data pipelines using Databricks and Medallion architecture for structured and unstructured data.
  • Implement data ingestion strategies from diverse sources (SAP, TrackWise, Salesforce, and others) ensuring high-quality, reliable data flow.
  • Ingest and process large volumes of data from Azure Blob Storage into Databricks for transformation and analytics.
  • Build and maintain silver and gold layers for curated, analytics-ready datasets.
  • Apply advanced statistical methods, including:
  • Anomaly Detection for identifying irregular patterns in operational and quality data.
  • Forecasting for demand, defect trends, and resource planning.
  • Root Cause Analysis to identify drivers of failures or complaints.
  • Risk Modeling to quantify and predict potential quality or operational risks.
  • Predictive Analytics for proactive decision-making and maintenance.
  • Pattern Detection to uncover hidden relationships in large datasets.
  • Develop and deploy NLP solutions for text-based data analysis, leveraging linguistic schemas for structured interpretation of unstructured data.
  • Create Power BI dashboards with:
  • Workflow automation (notifications, reminders, messaging).
  • AI-driven insights using prepped datasets for predictive and prescriptive analytics.
  • Implement near real-time tracking systems and alert mechanisms for critical events and operational KPIs.
  • Collaborate with cross-functional teams to align data solutions with business objectives and ensure visibility across the end-to-end operating cycle.
  • Document data workflows, maintain traceability, and ensure audit readiness for all data engineering activities.
  • Leverage knowledge of Quality Management Systems (QMS) to support compliance and continuous improvement

Key Requirements and Technology Experience:

  • Key Skills; Databricks, Medallion, Azure, data pipelines

Our client is a leading Medical Technology Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.