Overview
Remote
$60 - $70
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required
Skills
DataBricks
GCP
Python
SQL
Kafka
ETL
API Integrations
Job Details
Role: Sr. Data Engineer
Duration: 6-12 months
Location: Remote
Details:
MUST HAVES: DataBricks, Google Cloud Platform, and a Linkedin with proper Photo
Role Overview
As a Sr. Data Engineer, you will build and optimize data pipelines that support retail media campaigns and customer journey analytics. You ll work closely with architects, analysts, and media partners to deliver scalable, privacy-compliant data solutions.
Key Responsibilities
- Build and maintain data pipelines using Google Cloud Platform (BigQuery, Dataflow, Composer)
- Develop Python scripts for data transformation and ingestion
- Support real-time data streaming and campaign analytics
- Collaborate with users to deliver clean, validated datasets
- Integrate with clean room environments and ensure privacy compliance
- Build data models (e.g., slowly changing dimensions) for campaign and customer journey analytics
- Lead design and POC of migration planning from Google Cloud Platform to Databricks Connecting to Databricks for ML Use cases (Hosted in Google Cloud Platform)
- Enable real-time data ingestion and streaming (Kafka or similar)
Required Skills
- 8 10 years in data engineering
- Proficient in Python, SQL, and Google Cloud Platform tools (BigQuery, Dataflow, Composer)
- Experience with clean rooms (Google, Databricks)
- Familiarity with Kafka or similar streaming tools
- Strong understanding of retail media and campaign KPIs
- Expertise in ETL tools like Informatica or Talend
- API Integrations experience e.g. Facebook/Meta or similar engineering experience
- Bonus: Experience with Databricks and, Data/ ML pipelines
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.