Senior Data Engineer – AWS/GenAI

Client: EdTech

Title: Senior Data Engineer – AWS/GenAI

Duration: 12 Months (Contract to hire)

Location: 100% Remote

Summary

·        Data Engineer must be a skilled engineer with an unwavering passion for excellence in Software Engineering and drive to transform that passion into consistent excellence in product development.

·        The candidate must be customer-obsessed, have strong analytical and communication skills, enjoy working with native AWS services, and thrive on solving challenging business problems.

·        The candidate will partner with Product Owners/Architects, Developers, and other Software Engineers to help design, define, implement functional features, system level validation and verify features of product development.

·        Qualified candidates will show an aptitude learning and implementation of advanced software engineering practices in Data Analytics, AWS, Microservices environment to solve complex problems with a mission to release high quality software that is resilient and optimally performing.

·        Candidates will be engaged in both data and analytics reports development and quality engineering, testing and automation as a data engineer.

Responsibilities

·        Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

·        Builds, tests, deploys and maintains production code for complex transactional applications using event driven microservices, node.js, Python languages. Incorporates Cloud technologies on new application development to include micro-services, SQL and AWS services such as lambda, S3, SQS, SNS, DynamoDB, Quicksight, AWS Redshift, Opensearch.

·        Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance 

Required Skills

·        Expert in writing  and optimizing complex SQL queries for data extraction, transformation, and reporting (e.g., SELECT, JOIN, GROUP BY, HAVING, WINDOW functions).

·        Expert integrating Redshift Serverless with AWS services such as S3, Glue, Lambda, Athena, and Kinesis BI tools like Tableau, Quicksight, or Looker for real-time analytics and dashboardsExpert in building serverless ETL pipelines with Lambda to automate data ingestion and transformation into Redshift.

·        Experience in integrating Redshift Serverless with

·        Experience of NodeJS and Python

·        Working knowledge of any AI technologies

·        Experience in working with AWS services, deploying applications to AWS

·        Exposure to DevOps tools and automation

·        Effective communication skills are a must along with a strong customer service orientation, and the ability to clearly discern client needs.