Data Engineer

Overview

Remote
On Site
USD50 - USD58
Contract - W2

Skills

Data Engineer

Job Details

job summary:

Our Chicago area client has a contract opening for a Data Engineer to work with their AI/ML team. Ideal candidates will be in the Chicago area with the opportunity to work remote.





location: Telecommute

job type: Contract

salary: $50.00 - 57.57 per hour

work hours: 8am to 5pm

education: Bachelors



responsibilities:

  • Write and maintain complex SQL queries for large, real-time datasets to generate weekly data extracts
  • Develop scalable ELT and ML pipelines using Python and Databricks.
  • Automate workflows and implement data quality checks across pipelines.
  • Refactor existing pipelines to improve efficiency, maintainability, and configuration management.
  • Configure and optimize Databricks and Snowflake environments.
  • Migrate pipelines and data tables between environments.
  • Build Power BI dashboards for analytics and QC monitoring.
  • Advise on data architecture, including best practices for performance and scalability.
  • Document system design, data flows, and integration points.




qualifications:

Data engineering experience


Experience with Databricks, Snowflake, Azure (and related services).


SQL expertise, including query optimization and performance tuning, complex joins, window functions, CTEs, dynamic SQL, stored procedures, advanced aggregations (ROLLUP, CUBE), pivot/unpivot operations, and handling semi-structured data (JSON/XML).


Python programming for analytics, automation, workflow orchestration, and pipeline development, integration with ML frameworks and APIs.


Experience designing data architecture for large-scale analytics and ML workloads.


Building interactive dashboards in Power BI and applications in Streamlit.


Developing and deploying ML and Generative AI pipelines, including integration with model training and inference workflows.


Experience with Kafka and streaming data (a plus)


Experience with healthcare datasets (prescriptions, insurance claims, electronic health records (a plus)




Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.



Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.