Data Engineer III

Looking for a hybrid, onsite Data Engineer. The role focuses on designing, building, and managing the organization's analytics infrastructure and large-scale data processing systems. Key responsibilities include developing, testing, and maintaining robust data pipelines using technologies like Python, Scala, or Java and leveraging big data frameworks such as Apache Spark, Hadoop, or Flink. This involves assembling complex datasets from various sources into unified views, often utilizing cloud platforms (e.g., AWS, Azure, Google Cloud Platform), and creating data models using SQL/NoSQL databases (e.g., PostgreSQL, Snowflake, Cassandra) to enable analytics and business teams to derive insights. The position involves collaborating closely with data scientists, analysts, and application developers to ensure optimal data delivery, integrating new data management technologies, and automating operational improvements using tools like Airflow, Kubernetes, or specialized ETL/ELT platforms for data quality checks, error handling, and scalable, automated analytical solutions and enriched data feeds.

• Support or collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects/operations.
• Design, build, and manage analytics infrastructure that can be utilized by data analysts, data scientists, and non-technical data consumers, which enables functions of the big data platform for Analytics.
• Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems that help analyze and process data in the way the Analytics organization requires.
• Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools.
• Work closely with a team of Data Science staff to take existing or new models and convert them into scalable analytical solutions.
• Design, document, build, test and deploy data pipelines that assemble large complex datasets from various sources and integrate them into a unified view.
• Identify, design, and implement operational improvements: automating manual processes, data quality checks, error handling and recovery, re-designing infrastructure as needed.
• Create data models that will allow analytics and business teams to derive insights about customer behaviors
• Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications.
• Responsible for obtaining data from the System of Record and establishing batch or real-time data feed to provide analysis in an automated fashion.
• Develop techniques supporting trending and analytic decision making processes
• Apply technologies for responsive front-end experience Ensure systems meet business requirements and industry practices
• Research opportunities for data acquisition and new uses for existing data
• Develop data set processes for data modeling, mining and production
• Integrate data management technologies and software engineering tools into existing structures

Python

Spark

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.