Senior ETL/Data Engineer_10+years experience

Overview

Remote
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

ETL
SQL
Pyspark
AWS
Glue
Spark
Ruby on Rails

Job Details

  • 100% Remote
  • Work EST hours
  • Need a Sr. Resource who can articulate and perform at a high level on camera with heavy SLACK activity.
  • Client: LifeStance
  • Engagement: 2+ years Need them to start ASAAP
  • Any Citizenship

Vendors: I prefer No layers please, please screen for good video and communication presence, fake candidates will get you taken off my distro send you best 1 or 2

Must be a Data Engineer with a strong background in AWS Glue, PySpark, Python, Healthcare EMR, and AWS Step Functions.

  • 7+ years of development experience
  • 5+ years SQL Server experience
  • 5+ years of PySpark experience
  • 4+ years of AWS Cloud technology experience Glue and Step Functions
  • 2+ years Spark experience
  • 5+ years Glue experience
  • 2+ years Ruby on Rails experience
  • ETL Development

Job Title: Senior Data Engineer

  • 5+ years Job Overview: We are looking for a highly skilled and experienced Senior ETL Developer to join our team. The ideal candidate will have extensive experience in AWS Redshift, PostgreSQL, SQL Server, Git, AWS Glue, Spark and Python. You will be responsible for designing, developing, and maintaining complex ETL processes that enable smooth and efficient data integration, transformation, and loading across multiple systems. You should have excellent problem-solving skills and be able to work both independently and collaboratively within a dynamic environment.

Key Responsibilities:

  • Design, develop, and optimize ETL pipelines to support data integration between diverse data sources, including AWS Redshift, PostgreSQL, and SQL Server. Collaborate with business stakeholders and data engineers to gather requirements, define data workflows, and ensure alignment with business goals. Develop Python scripts to automate ETL processes, enhance data workflows, and solve complex data challenges.
  • Ensure data quality, integrity, and reliability throughout all stages of the ETL process. Optimize database queries and data transformations for high performance in AWS Redshift, PostgreSQL, and SQL Server. Perform data analysis and troubleshooting to identify and resolve ETL issues.
  • Work closely with cross-functional teams to support data-driven projects and improve existing ETL workflows.
  • Implement best practices for data governance, security, and compliance in all ETL processes. Mentor junior team members and provide guidance on best ETL practices.

Key Requirements:

  • Experience: Minimum 7+ years of hands-on experience in ETL development, with a focus on AWS Glue, PySpark, AWS Step Functions, SQL, and Redshift, PostgreSQL, and SQL Server. Expertise in AWS: Strong experience with AWS services, especially Redshift, Lambda, S3, and RDS.
  • Python Programming: Proficiency in Python for scripting, data transformation, and automation of ETL tasks.
  • SQL Skills: Deep understanding of SQL query optimization, stored procedures, and database design.
  • Data Modeling: Experience in designing and implementing data models for relational and dimensional databases.
  • Problem Solving: Excellent problem-solving skills with a track record of resolving complex technical issues in data engineering and ETL workflows. Tools &
  • Technologies: Familiarity with ETL tools (e.g., AWS Glue, Talend, Informatica) and version control systems (e.g., Git). Analytical Mindset: Strong attention to detail with the ability to analyze data and improve data quality.
  • Communication: Excellent verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.