Data Engineer (AWS Glue, Airflow, Lambda, Postgres)

Fort Mill, SC, US • Posted 17 hours ago • Updated 17 hours ago
Contract Corp To Corp
Contract W2
7 Months
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Data Engineer (AWS Glue
  • Airflow
  • Lambda
  • Postgres)

Summary

We are looking for a Data Engineer (AWS Glue, Airflow, Lambda, Postgres) for our client in Fort Mill, SC
Job Title: Data Engineer (AWS Glue, Airflow, Lambda, Postgres)
Job Location: Fort Mill, SC
Job Type: Contract
Job Overview:
Pay Range: $60hr - $65hr
Responsibilities:
  • Design and develop scalable data pipelines using AWS Glue, Lambda, and Event Bridge for event-driven and batch processing.
  • Build and maintain AWS Glue ETL jobs (Spark/Python) for data ingestion, transformation, and curation across data lake layers.
  • Develop and manage Airflow DAGs (MWAA or self-managed) to orchestrate data workflows, triggers, and dependencies across AWS services.
  • Implement event-driven architectures using AWS Lambda and Event Bridge for near real-time data processing.
  • Write, optimize, and maintain complex SQL queries in Postgres for data validation, transformation, and reporting.
  • Manage metadata and schema definitions using AWS Glue Data Catalog, ensuring proper governance and discoverability.
  • Build and support robust data ingestion frameworks for batch and near real-time data pipelines.
  • Monitor and troubleshoot pipeline performance using AWS monitoring tools (CloudWatch, logs, alerts).
  • Collaborate with downstream teams (BI, analytics, and Snowflake if applicable) to ensure reliable data consumption.
  • Contribute to system reliability, scalability, and performance optimization of the data platform.
Required Skills and Qualifications:
  • 6+ years of experience in Data Engineering or a related field.
  • Strong hands-on expertise in AWS Glue, Lambda, Event Bridge, and S3.
  • Experience building and orchestrating workflows using Apache Airflow (MWAA preferred).
  • Strong proficiency in SQL (Postgres preferred) for complex transformations and performance tuning.
  • Experience with Python / Spark for ETL development.
  • Solid understanding of event-driven data architecture and pipeline design.
  • Familiarity with AWS IAM, CloudWatch, and logging/monitoring frameworks.
  • Experience with CI/CD pipelines (e.g., GitHub Actions) for deployment automation.
Preferred Skills:
  • Experience with Terraform or infrastructure-as-code tools.
  • Knowledge of data lake formats (Parquet, Iceberg, Delta).
  • Understanding of data modeling, partitioning, and schema evolution.
  • Familiarity with AWS services such as Lake Formation, SNS, and CloudTrail.
  • Exposure to Snowflake or other data warehouse platforms is a plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10516350
  • Position Id: SC_DEGF_0527
  • Posted 17 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

Today

Easy Apply

Contract

$57.78

Charlotte, North Carolina

8d ago

Easy Apply

Contract

$65.14 - $75.15

Charlotte, North Carolina

Today

Easy Apply

Contract

$69.5 - $76.16

Charlotte, North Carolina

Today

Easy Apply

Contract

$70.00 - $70.23 per hour

Search all similar jobs