Senior Data Engineers

Senior Data Engineers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, and maintain scalable pipelines for batch, real time, and streaming data workloads, modules, modular and reusable components, internal frameworks, libraries, code, script, schemas, test cases, project plans. Review performance, data extraction and transformation, validation, reporting, software engineering planning, requirements, data solutions and anomalies, bottlenecks, bugs, data engineering best practices, version control, cloud platforms, open-source relational databases, APIs, design patterns, jobs, memory, configurations, partitioning, caching, data validation checks, data lineage and metadata, technical specifications, root cause, workflows, data models, data governance policies, compliance, security, clustering, dashboards, audits, risks, mitigation. Write queries, perform data profiling, optimize code, automate testing, perform unit and SIT testing. Identify problems, analyze client/user needs, recommend modifications. Use ETL, PySpark, SQL, Unix, Shell, Hive, RDBMS, Git, AWS, Azure, S3, ADLS, Spark, CI/CD, Python, Linux, Demio, Snowflake, Iceberg, Parquet, Git, DBT, Pytest, Jira, Jenkins, SonarQube, Liquibase, Autosys. 40 hrs/wk. Must have Master's degree or foreign equivalent in Computer Science, Computer Engineering, Electronic Engineering, or a related field, and 2 years experience in the proffered position or as a Developer, Software Engineer, Technology Analyst, Programmer Analyst, or related occupation. In the alternative, will accept a Bachelor's degree or foreign equivalent in the specified fields plus 5 years of progressive, post-baccalaureate experience in the specified occupations. Must have 2 years of experience developing pipelines, scripts; analyzing data and components; performing validation, data profiling, unit testing; working with cloud platforms; reviewing requirements, jobs, partitioning, metadata, workflows, data models, security; writing queries; optimizing code; using ETL, PySpark, SQL, Unix, Shell, RDBMS, Azure, S3, ADLS, Spark, CI/CD, Python, Linux, Snowflake, Jenkins, Autosys. Must be willing to travel/relocate to unanticipated locations throughout the US on short notice for extended periods of time. Telecommuting permitted. $178,132 to $178,150 /yr. Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). To apply, email resume to rd-apply.rits@randstaddigital.com. Reference job title Senior Data Engineers and Ref ID# 472749 in the subject line. This position is eligible for incentives pursuant to Randstad Digital, LLC Employee Referral Program.