Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
AWS
Python
Spark
Pyspark
ETL
Java
data transformation
data pipelines
data engineering
Job Details
Key Responsibilities
- Partner with business stakeholders and data science teams to gather requirements and translate them into cloud-based data solutions.
- Architect and implement data pipelines on AWS leveraging services such as S3, Redshift, Glue, EMR, Kinesis, and Lambda.
- Develop data transformation workflows using AWS Glue, Microservices, or Node.js.
- Select and optimize AWS storage solutions for structured, semi-structured, and unstructured data.
- Establish and enforce data governance, compliance, and security best practices across the data lifecycle.
- Automate infrastructure deployment using Terraform or CloudFormation (IaC).
- Monitor, troubleshoot, and optimize pipeline performance, scalability, and cost efficiency.
- Maintain comprehensive architecture and pipeline documentation.
- Stay current with emerging AWS cloud technologies and data engineering frameworks.
Qualifications
- 15+ years of experience in data engineering, data architecture, or related domains.
- Strong expertise in AWS-based data pipelines and architectures.
- Proficiency with Python, Java, or similar scripting languages, and hands-on experience with Spark / PySpark.
- Proven experience with AWS analytics and data services (S3, Redshift, Glue, EMR, Kinesis, Lambda).
- Solid understanding of data modeling, ETL design, and storage strategies.
- Knowledge of data security, compliance, and governance best practices.
- Strong communication and stakeholder management skills.
- Ability to lead solution design independently and work in cross-functional environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.