Senior Data Engineer

  • Chicago, IL
  • Posted 14 days ago | Updated 4 hours ago

Overview

On Site
Full Time

Skills

Business requirements
Google Cloud
Data governance
Decision-making
Data quality
Data engineering
Apache Spark
A/B testing
Business intelligence
Data Science
Big data
Data Analysis
Data architecture
Data modeling
Customer support
Online training
Data
Policies
SAP BASIS
Design
Scalability
Continuous integration
Continuous delivery
Software deployment
Collaboration
Strategy
Meta-data management
Mentorship
Database
Information retrieval
ERwin
HDFS
Analytics
Amazon Web Services
Cloud computing
Finance
Accounting
Marketing
Creativity
Legal
Artificial intelligence
Insurance
.NET

Job Details

Description

We are seeking a Data Engineer to join our client's team in Chicago. The individual will play a key role in our data-driven organization, building data solutions that power strategic and tactical business decisions. The Data Engineer will work on implementing the data platform, data pipelines, and data governance policies that form the basis for decision-making in our organization.

Responsibilities:

Work closely with various teams to gather and understand business requirements

Design, develop, deploy, and support high-performance data pipelines both inbound and outbound

Optimize data pipelines for performance, scalability, and reliability

Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products

Ensure the quality of critical data elements, prepare data quality remediation plans, and collaborate with business and system owners to fix quality issues

Document the design and support strategy of the data pipelines

Capture, store, and socialize data lineage and operational metadata

Troubleshoot and resolve data engineering issues as they arise

Develop REST APIs to expose data to other teams within the company

Mentor and guide junior data engineers.

Requirements

Must have 7+ years of experience as a Data Engineer or in a similar role.

Proven expertise in Apache Spark, Database, and EO/IR systems.

Experience with Erwin Data, HDFS, and AB Testing is required.

Strong skills in Analytics and AWS Technologies.

Knowledge of Business Intelligence (BI) and Business Requirement Document is necessary.

Prior experience in Applied data science, Big Data, Cloud databases, Data Analysis, Data Analytics, and Data Architecture.

Familiarity with Data capture, Data construction, and Data coordination is desired.

Experience in handling Data lakes and Data Interpretation is preferred.

Proficiency in Data Modeling, Data Science, and Google Cloud Dataproc is necessary.

Knowledge of Google Cloud Datastore, Google Data Studio, and BigQuery is essential.

Familiarity with Google Cloud Platform is an advantage.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.

About Robert Half