Senior Data Engineer (AWS & Spark with Java)

Job Title: Senior Data Engineer (AWS & Spark with Java)
Location: Wilmington, DE / Plano, TX (100% Onsite)
Contract Duration: (6 Months)
Compensation: $55/hr (W2)

Position Overview
We are seeking a Senior Data Engineer with 8–10 years of experience to lead the development of scalable ETL/ELT processes. This role requires a unique combination of Core Java and Apache Spark expertise within an AWS environment. You will be responsible for building high-performance data pipelines that integrate diverse sources into S3-based data lakes and Redshift data warehouses.

Key Responsibilities

* Advanced Pipeline Development: Design and implement scalable ETL/ELT workflows using Apache Spark with Java.
* AWS Stack Management: Leverage AWS services including S3, Redshift, Glue, EMR, Lambda, Kinesis, and DynamoDB.
* Performance Tuning: Optimize Spark applications for cost-efficiency and reliability, including tuning configurations and resource allocation.
* Data Architecture: Design data models for structured and unstructured data and contribute to the overarching cloud data strategy.
* Real-time Processing: Utilize AWS Kinesis for streaming data ingestion and processing.
* Collaboration: Partner with data scientists and analysts to translate business requirements into technical data solutions.

Required Qualifications

* Experience: 8–10 years of professional data engineering experience.
* Programming: Expert-level Core Java (mandatory for Spark applications).
* Big Data Tech: Hands-on experience with Apache Spark (SQL, DataFrames, RDDs).
* Cloud Infrastructure: Extensive experience with AWS data services (Glue, EMR, Kinesis, Lambda).
* Databases: Proficiency in SQL and experience with both Relational and NoSQL databases.