Data Engineer

Randstad Digital is seeking an experienced Data Engineer for an exciting opportunity in Chicago, IL.

GENERAL DESCRIPTION: The Data Engineer role will play a role accomplishing the following team goals: Data Centralization, Data Governance, and Data Integrity. They will be focused on building data pipelines, expanding Data Lakehouse functionality, and maintenance of the on-prem data warehouse. They must be well organized, flexible, and able to communicate effectively with all levels of the organization.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

Build and maintain data pipelines using Google Cloud Platform tools such as Dataflow, Apache Beam, BigQuery, Cloud Composer, and Pub/Sub

Ingest, transform, and store structured and unstructured data from various sources

Experience with deployment in docker image and testing with pytests

Write efficient, well-documented SQL and Python code for data processing and analysis

Design performance-focused tables and databases, and perform volume testing and tuning of queries to ensure efficiency

Build data service solutions such as data marts and designing complex models for specific business use cases

Manage infrastructure as code using Terraform

Monitor pipeline performance and resolve issues using Cloud Monitoring and logging

Take technical direction from senior engineers and architects as well as collaborate with data analysts, scientists, and engineers to understand data requirements and deliver solutions

Apply security best practices and ensure data is handled securely and in compliance with internal policies and procedures

Participate in the on-call rotation and perform operational support tasks

ADDITIONAL DESIRED DUTIES/RESPONSIBILITIES:

Exposure or experience with creating, and enhancing Google Cloud Platform data lakehouse preferred

Minimum Required Experience:

3 - 4 years of experience as a data engineer or comparable Business Intelligence role

3 - 4 years minimum experience with relational databases such as MS-SQL, Postgres, or Oracle

2 - 3 years of experience with NoSQL databases such as Capella or MongoDB

1 - 2 years Python experience or similar

Proficient with Cloud offerings primarily with Google Cloud Platform (Azure or AWS is acceptable)

Desirable Education/Experience:

1-3 years of logistics or transportation experience

ESSENTIAL DUTIES AND RESPONSIBILITIES:

• Build and maintain data pipelines using Google Cloud Platform tools such as Dataflow, Apache Beam, BigQuery, Cloud Composer, and Pub/Sub
• Ingest, transform, and store structured and unstructured data from various sources
• Experience with deployment in docker image and testing with pytests
• Write efficient, well-documented SQL and Python code for data processing and analysis
• Design performance-focused tables and databases, and perform volume testing and tuning of queries to ensure efficiency
• Build data service solutions such as data marts and designing complex models for specific business use cases
• Manage infrastructure as code using Terraform
• Monitor pipeline performance and resolve issues using Cloud Monitoring and logging
• Take technical direction from senior engineers and architects as well as collaborate with data analysts, scientists, and engineers to understand data requirements and deliver solutions
• Apply security best practices and ensure data is handled securely and in compliance with internal policies and procedures
• Participate in the on-call rotation and perform operational support tasks

Minimum Required Experience:

3 - 4 years of experience as a data engineer or comparable Business Intelligence role

3 - 4 years minimum experience with relational databases such as MS-SQL, Postgres, or Oracle

2 - 3 years of experience with NoSQL databases such as Capella or MongoDB

1 - 2 years Python experience or similar

Proficient with Cloud offerings primarily with Google Cloud Platform

Desirable Education/Experience:

1-3 years of logistics or transportation experience

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.