Apply Now

Senior AWS Data Engineer

Remote • Posted 2 days ago • Updated 8 hours ago

Full Time

Remote

USD $145,000.00 - 160,000.00 per year

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

Regulatory Compliance
Data Warehouse Architecture
Business Rules
Warehouse
Modeling
Collaboration
Amazon RDS
Remote Desktop Services
Access Control
Caching
Broadcasting
Query Optimization
Git
Continuous Integration
Continuous Delivery
GitLab
Jenkins
Mapping
Data Flow
Meta-data Management
Auditing
Agile
Extract
Transform
Load
ELT
Workflow
Reporting
Analytics
Data Engineering
Cloud Computing
SQL
Amazon S3
Step-Functions
Orchestration
Terraform
Amazon Web Services
Data Quality
Storage
Optimization
Business Analysis
Business Analytics
Communication
Organizational Skills
Management
DoD
Security Clearance
Apache Spark
Scala
Java

Summary

Job Type

Full-time

Description

Key Responsibilities

Build and maintain scalable data pipelines in AWS to support ingestion, transformation, and enrichment of structured and semi-structured data.
Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.
Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.
Leverage AWS tools to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices.
Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.
Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.
Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins.
Monitor pipeline health, job execution, and cluster utilization using AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs.
Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.
Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic.
Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams.

Disclaimer "The responsibilities and duties outlined in this job description are intended to describe the general nature and level of work performed by employees within this role. However, they are not exhaustive and may be subject to change or modification at any time to meet the evolving needs of the organization and client.

Requirements

Required Qualifications

This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines
The ideal candidate brings both engineering and strategic insight into enterprise data modernization
8+ years of experience in data engineering and Agile analytics
5 years of experience building scalable ETL and ELT workflows for reporting and analytics
3+ years of experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS
Hands-on experience in the following:
- Glue / Spark SQL-based data transformations
- S3 partitioning strategy
- Step Functions-based orchestration
- Infrastructure as Code (Terraform and/or CloudFormation)
- Deployment automation for data pipelines
- AWS services integration
Experience with data quality, validation frameworks, and storage optimization strategies
BA or BS degree
Excellent communication and organizational skills with the ability to manage multiple priorities
U.S. Citizenship is required by the Federal Client
Must have or able to obtain DoD Public Trust Clearance

Preferred Qualifications

Experience building data pipelines using Spark with Java or Scala
Strong Java development experience in enterprise environments

Salary Description

$145,000 - $160,000

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91130353
Position Id: 45fdd6d99b1d3009fe7cd2f79935dbf7
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AWS Data Engineer

Remote or Atlanta, Georgia

•

Today

At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company's growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. For more than 25 years, NTT DATA Services have focused on impacting the core of your business operations with industry-leading outsourcing

Full-time

USD 65.00 - 70.00 per hour

Senior AWS Lead Data Engineer

Remote

•

2d ago

AWS Lead Data Engineer Start ASAP (2-4 WEEKS) Duration 12 months This is a remote role; we prefer candidates in Southern CA, CA, or West Coast. Experience: 10+ Years MUST HAVE OIL AND GAS, UTILITY OR PIPELINE INDUSTRY EXPERIENCE Job Description: SENIOR AWS TECH LEAD DATA ENGINEER We do not need architects or Big Data engineers. We need an AWS Lead Data engineer who can perform hands-on coding on these tools: Python, Pandas, PySpark, Terraform, AWS Glue, Lambda, S3, Redshift, EMR. Lets make sure

Easy Apply

Contract

Depends on Experience

Senior Data Scientist

Remote or Minnetonka, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us adv

Full-time

USD 91,700.00 - 163,700.00 per year

Senior Data/Systems Analyst

Remote

•

Today

Job Type Full-time Description Key Responsibilities Lead the design, implementation, and management of data integration and data platform solutions with a focus on performance, scalability, and reliabilityEstablish and enforce best practices for data integration, ETL/ELT, automation, monitoring, and data qualityDesign and maintain cloud and/or on-premise data warehouses, data lakes, and data access APIsOversee data modeling efforts including dimensional modeling, denormalized structures, and O

Full-time

USD 130,000.00 - 150,000.00 per year

Search all similar jobs