Overview
Remote
Depends on Experience
Full Time
No Travel Required
Skills
AWS
Data Streaming
Databricks
Data lake
Spark Streaming
Kafka
Docker
Kubernetes
Data pipelines
Redshift
Glue
EMR
Spark
CI/CD
ADF
Snowflake
Job Details
Job Title: AWS Data Engineer with Data Streaming
Location: Remote Employment Type: Full-time
AWS Certification is Must
Job Description: We are seeking a skilled AWS Data Engineer to design, build, and maintain scalable, high-performance data pipelines and solutions. The ideal candidate will have strong expertise in AWS services, advanced SQL, and Python, with hands-on experience in data integration, transformation, and analytics.
Key Responsibilities:
- Design, develop, and maintain robust ETL/ELT data pipelines using AWS services such as Redshift, Glue, and EMR (optional).
- Work with streaming data platforms to ingest, process, and store real-time data efficiently.
- Write and optimize complex SQL queries for data transformation, analytics, and reporting.
- Develop scalable Python-based solutions for data ingestion, cleansing, and processing.
- Collaborate with data analysts, scientists, and business teams to ensure data quality, integrity, and accessibility.
- Implement data modeling best practices for analytics and reporting.
- Ensure adherence to data security and compliance standards.
- (Nice to have) Integrate and manage workloads in Snowflake for analytical purposes.
Required Skills & Qualifications:
- Minimum 10+ Years IT Experience required.
- Proven experience as a Data Engineer with hands-on Cloud (AWS) expertise with Data Streaming.
- Strong proficiency in AWS Redshift, Glue.
- AWS Certification is Must
- Advanced SQL and Python programming skills.
- Experience with real-time / streaming data ingestion and processing (e.g., Kinesis, Kafka).
- Experience with Databricks, Data lake, Spark Streaming, Kafka, Docker, Kubernetes, Data pipelines.
- Azure data factory
- Familiarity with AWS EMR optional
- Exposure to Snowflake is plus
- Solid understanding of ETL processes, data modeling, and performance optimization.
- Strong problem-solving skills and ability to work in collaborative environments.
Preferred Qualifications:
- AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect.
- Experience with CI/CD for data pipelines.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.