Senior Data Engineer

  • Pleasanton, CA
  • Posted 14 hours ago | Updated 14 hours ago

Overview

On Site
Full Time
Contract - W2

Skills

Data Governance
Management
Data Modeling
Data Warehouse
Data Architecture
Cloud Computing
Amazon Web Services
Google Cloud
Google Cloud Platform
Programming Languages
Data Processing
Apache Spark
Extract
Transform
Load
PySpark
Machine Learning Operations (ML Ops)
Machine Learning (ML)
Analytical Skill
Problem Solving
Conflict Resolution
Communication
Collaboration
SQL
Databricks
Microsoft Azure
Shell Scripting
Python
Computer Science

Job Details

What you'll do:

  • Ensure adherence to data governance standards and practices
  • Design and develop data applications based on business requirements
  • Manage user access and permissions for applications and infrastructure
  • Maintain and support existing data applications and pipelines
  • Troubleshoot and resolve issues in a timely manner
  • Provide ongoing support and enhancements to existing systems
  • Collaborate with teams and vendors to align on technical solutions and requirements

What you know:

  • Strong proficiency in data modeling, data warehousing, and data architecture.
  • Experience with cloud platforms like AWS, Azure, or Google Cloud.
  • Proficiency in programming languages like Python and experience with distributed data processing frameworks like Apache Spark.
  • Experience with data pipeline development using tools like PySpark, Databricks, and Delta Lake.
  • Experience with MLOps practices and machine learning model deployment.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.
Key Skills:
  • SQL
  • Databricks
  • Microsoft Azure
  • Shell Scripting
  • Python

Education:
Bachelors degree in Computer Science or equivalent experience

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.