Data Engineer

Piedmont, CA, US • Posted 12 hours ago • Updated 11 hours ago
Contract W2
31 Weeks
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • PySpark

Summary

Data Engineer 

Job at a Glance 
Title: Data Engineer 
Location: Remote 
Contract: W2 only, 6-month contract with potential for extension or conversion to full time with either the client or CEI 
Pay: $65/hour + optional medical, dental, vision, 401(k) match 

Overview 
This role involves working on a Salesforce data migration project, focusing on data pipelines into Data Bricks. The candidate will collaborate with a senior engineer and participate in weekly Scrum ceremonies, contributing to the development of core CRM databases for Comcast advertising. The position emphasizes data engineering, ETL development, and cloud data platform integration. 

Key Responsibilities 

  • Creation, management and operation of a diverse set of Dev-Ops-related tools, processes, paradigms and technologies that enable the creation and ongoing operation of the Signify IoT Platform. 

  • Focus on the creation of horizontal tools, technologies and best-practices that enable and support all the IoT Platform engineering teams to build, debug, test, release, manage and secure the IoT Platforms modern, microservices-based cloud infrastructure. 

  • Collaborate in defining the methodologies and ways-of-working that will enable our fast-paced engineering teams to flourish as we collectively build-out the IoT Platform. You will help promote and implement best practices and supporting tools/technologies for source control management, CI and CD architectures, performance, SLAs, security, audit and monitoring that will be used by every engineer within the IoT Platform organization. 

  • Define common frameworks and software libraries, in various programming languages, that support the creation of efficient, scalable and highly available microservice-based architectures. 

  • Support with the management of the running IoT Platform system architecture. You will troubleshoot issues and identify areas for continuous improvement with a particular emphasis on quality, performance and security. 

  • Work closely with architects and technical product managers and other members of your team to translate overall system architecture and product requirements into well-designed, implemented and tested software solutions. 

  • Work in an Agile environment to deliver high-quality software in an incremental manner. 

  • Help promote the adoption of best-in-class software engineering practices, frameworks, and tools. You are providing guidance and feedback to other software developers. 

Required Skills 

  • B.Sc. in Computer Science or related Engineering (Masters degree desirable) 

  • 8+ years of proven, hands-on track-record as a software engineer, focused on cloud-based systems 

  • Mastery of a variety of programming languages - at least Java, Python, with knowledge of Golang or JavaScript (NodeJS) desirable. Strong Java Development skills, preferably with Ver. 1.8 

  • Proven track record developing cloud-based services (SaaS) and platforms (PaaS) 

  • Proven hands-on in-depth experience of AWS, including EC2, S3, DynamoDB, RDS, Lambda, API Gateway, Fargate 

  • Proven experience of developing microservices and complex microservice-based platform architectures 

  • Excellent understanding of distributed systems, designing for scalability, performance and availability 

  • Experience establishing non-functional best-practices and deploying supporting technologies for security (including audit) and reliability (latency, availability, scalability) 

  • Knowledge of distributed network architectures and network security 

  • Good knowledge of data persistence technologies including relational databases and no-SQL solutions 

  • Excellent interpersonal and technical communication skills with a can-do attitude 

  • 3+ years in teams applying modern agile software development practices 

Preferred Skills 

  • Salesforce experience (plus) 

  • Spark and PySpark expertise 

  • Data pipelines and data integration projects experience, specifically with Data Bricks 

  • 7-9 years of experience in data engineering and data migration projects 

Why Should I Apply? 
This position offers the opportunity to work on a high-impact cloud data platform project with a leading organization, utilizing cutting-edge technologies in a collaborative, agile environment. It is ideal for experienced data engineers seeking to advance their expertise in cloud and data platform development. 

About CEI: 
As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers'' workforce and project requirements. 

#ZR #INDGEN 

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: ceiam
  • Position Id: 32058
  • Posted 12 hours ago
Contact the job poster
HT

Hope Tomacruz

Recruiter @ Computer Enterprises, Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

San Francisco, California

Today

Easy Apply

Contract, Third Party

Depends on Experience

Hybrid in San Francisco, California

3d ago

Easy Apply

Contract

Depends on Experience

Alameda, California

3d ago

Easy Apply

Contract, Third Party

70 - 90

San Francisco, California

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs