Data Engineer

job summary:

Responsibilities

Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.

Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.

Integrates a complex data ecosystem spanning across a multitude of Products, data stores, and repositories in order to drive insights into the current landscape of our Egress Risk.

Partners with internal clients to gain an expert understanding of business functions and informational needs. Works closely with other technical and data analytics experts across the business to implement data solutions.

Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.

Qualifications

Must-Have Skills

SQL & Data Modeling - Robust ability to design schemas and write optimized queries.

Python for ETL/Automation - Building pipelines using Pandas for data wrangling and transformation.

Cloud Data Services - Dremio, AWS Glue, S3, Lambda etc.

Data Quality & Governance - Implementing validation, lineage, and compliance checks.

Creating Data Products & Views - Ability to design curated datasets, materialized views, and reusable data assets for analytics.

CI/CD & Version Control - Git, Bamboo, Bitbucket.

Proactive Infrastructure Setup - Ability to design and implement scalable, secure data infrastructure for the team, ensuring readiness for future growth.

Nice-to-Have Skills

Big Data Frameworks - Spark for distributed processing.

Collaboration & Requirement Gathering - Work closely with cross-functional teams to understand business needs and translate them into technical solutions.

Orchestration Tools - Airflow or AWS Step Functions.

Monitoring & Logging - AWS CloudWatch for pipeline health and alerting.

location: Malvern, Pennsylvania

job type: Contract

salary: $56.33 - 61.33 per hour

work hours: 8am to 5pm

education: Bachelors



responsibilities:

Responsibilities

• Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.
• Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.
• Integrates a complex data ecosystem spanning across a multitude of Products, data stores, and repositories in order to drive insights into the current landscape of our Egress Risk.
• Partners with internal clients to gain an expert understanding of business functions and informational needs. Works closely with other technical and data analytics experts across the business to implement data solutions.
• Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.

qualifications:

Qualifications

Must-Have Skills

SQL & Data Modeling - Robust ability to design schemas and write optimized queries.

Python for ETL/Automation - Building pipelines using Pandas for data wrangling and transformation.

Cloud Data Services - Dremio, AWS Glue, S3, Lambda etc.

Data Quality & Governance - Implementing validation, lineage, and compliance checks.

Creating Data Products & Views - Ability to design curated datasets, materialized views, and reusable data assets for analytics.

CI/CD & Version Control - Git, Bamboo, Bitbucket.

Proactive Infrastructure Setup - Ability to design and implement scalable, secure data infrastructure for the team, ensuring readiness for future growth.

Nice-to-Have Skills

Big Data Frameworks - Spark for distributed processing.

Collaboration & Requirement Gathering - Work closely with cross-functional teams to understand business needs and translate them into technical solutions.

Orchestration Tools - Airflow or AWS Step Functions.

Monitoring & Logging - AWS CloudWatch for pipeline health and alerting.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.