Data Engineer
Job at a Glance
Title: Data Engineer
Location: Remote
Contract: W2 only, 6-month contract with potential for extension or conversion to full time with either the client or CEI
Pay: $65/hour + optional medical, dental, vision, 401(k) match
Overview
This role involves working on a Salesforce data migration project, focusing on data pipelines into Data Bricks. The candidate will collaborate with a senior engineer and participate in weekly Scrum ceremonies, contributing to the development of core CRM databases for Comcast advertising. The position emphasizes data engineering, ETL development, and cloud data platform integration.
Key Responsibilities
-
Creation, management and operation of a diverse set of Dev-Ops-related tools, processes, paradigms and technologies that enable the creation and ongoing operation of the Signify IoT Platform.
-
Focus on the creation of horizontal tools, technologies and best-practices that enable and support all the IoT Platform engineering teams to build, debug, test, release, manage and secure the IoT Platforms modern, microservices-based cloud infrastructure.
-
Collaborate in defining the methodologies and ways-of-working that will enable our fast-paced engineering teams to flourish as we collectively build-out the IoT Platform. You will help promote and implement best practices and supporting tools/technologies for source control management, CI and CD architectures, performance, SLAs, security, audit and monitoring that will be used by every engineer within the IoT Platform organization.
-
Define common frameworks and software libraries, in various programming languages, that support the creation of efficient, scalable and highly available microservice-based architectures.
-
Support with the management of the running IoT Platform system architecture. You will troubleshoot issues and identify areas for continuous improvement with a particular emphasis on quality, performance and security.
-
Work closely with architects and technical product managers and other members of your team to translate overall system architecture and product requirements into well-designed, implemented and tested software solutions.
-
Work in an Agile environment to deliver high-quality software in an incremental manner.
-
Help promote the adoption of best-in-class software engineering practices, frameworks, and tools. You are providing guidance and feedback to other software developers.
Required Skills
-
B.Sc. in Computer Science or related Engineering (Masters degree desirable)
-
8+ years of proven, hands-on track-record as a software engineer, focused on cloud-based systems
-
Mastery of a variety of programming languages - at least Java, Python, with knowledge of Golang or JavaScript (NodeJS) desirable. Strong Java Development skills, preferably with Ver. 1.8
-
Proven track record developing cloud-based services (SaaS) and platforms (PaaS)
-
Proven hands-on in-depth experience of AWS, including EC2, S3, DynamoDB, RDS, Lambda, API Gateway, Fargate
-
Proven experience of developing microservices and complex microservice-based platform architectures
-
Excellent understanding of distributed systems, designing for scalability, performance and availability
-
Experience establishing non-functional best-practices and deploying supporting technologies for security (including audit) and reliability (latency, availability, scalability)
-
Knowledge of distributed network architectures and network security
-
Good knowledge of data persistence technologies including relational databases and no-SQL solutions
-
Excellent interpersonal and technical communication skills with a can-do attitude
-
3+ years in teams applying modern agile software development practices
Preferred Skills
-
Salesforce experience (plus)
-
Spark and PySpark expertise
-
Data pipelines and data integration projects experience, specifically with Data Bricks
-
7-9 years of experience in data engineering and data migration projects
Why Should I Apply?
This position offers the opportunity to work on a high-impact cloud data platform project with a leading organization, utilizing cutting-edge technologies in a collaborative, agile environment. It is ideal for experienced data engineers seeking to advance their expertise in cloud and data platform development.
About CEI:
As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers'' workforce and project requirements.
#ZR #INDGEN