AWS Data Engineer

Job role: AWS Data Engineer

Location: Boston, MA, Arlington, VA, Atlanta, GA,:Austin, TX, Chicago, IL, Cleveland, OH

Experience: 8 Years

Skills:

This Staff Consultant role builds governed data platforms, data pipelines, lakehouse layers, reporting and analytics on AWS. The consultant is expected to operate as an embedded AWS SME, provide hands-on implementation support, and create audit-ready technical documentation aligned to regulated Financial Services delivery expectations.

·        Update the app to use Aurora DSQL work with architect to validate the distributed app with Aurora Global and work with the DevOps for primary writer failover scenarios

·         Aurora DSQL Migration Leadership: Lead application migration from existing database to Amazon Aurora DSQL, ensuring distributed SQL capabilities, multi-region active-active architecture, and serverless scalability

·         Distributed Architecture Validation: Collaborate with architects to design and validate distributed application patterns using Aurora Global Database, including cross-region replication, conflict resolution, and data consistency strategies

·         High Availability & Failover: Partner with DevOps teams to implement and test primary writer failover scenarios, automated failover mechanisms, and disaster recovery procedures for Aurora DSQL clusters

Application Refactoring: Update application code to leverage Aurora DSQL features including distributed transactions, connection pooling, and optimized query patterns for multi-region deployments

Database & Data Management:

·         Amazon Aurora DSQL: Expert-level knowledge of Aurora DSQL architecture, distributed SQL capabilities, serverless auto-scaling, and multi-region active-active configurations

·         Amazon Aurora Global Database: Hands-on experience with cross-region replication, read replica management, and global database topology design

·         AWS Database Migration Service (DMS): Proficiency in database migration strategies, schema conversion, and continuous data replication

·         Amazon RDS Proxy: Connection pooling and failover management for Aurora clusters

High Availability & Disaster Recovery:

·         Aurora Failover Mechanisms: Deep understanding of automatic failover, manual failover procedures, and failover priority configurations

·         AWS Backup: Automated backup strategies, point-in-time recovery, and cross-region backup replication

·         Amazon Route 53: DNS-based failover routing, health checks, and multi-region traffic management

Monitoring & Observability:

·         Amazon CloudWatch: Database performance metrics, custom alarms, and automated failover notifications

·         AWS X-Ray: Distributed tracing for database queries and transaction analysis

·         Amazon RDS Performance Insights: Query performance tuning and bottleneck identification

Security & Compliance:

·         AWS IAM: Database authentication, fine-grained access control, and IAM database authentication

·         AWS Secrets Manager: Secure credential rotation and database connection string management

·         AWS KMS: Encryption at rest and in transit for Aurora DSQL clusters

Infrastructure & Automation:

·         AWS CloudFormation / Terraform: Infrastructure-as-Code for Aurora DSQL cluster provisioning and multi-region deployments

·         Amazon VPC: Network isolation, security groups, and cross-region VPC peering for Aurora Global Database

·         AWS Systems Manager: Parameter Store for configuration management and automated runbooks for failover procedures

DevOps & CI/CD:

·         AWS CodePipeline / CodeBuild / CodeDeploy: Automated deployment pipelines for application updates with database schema migrations

·         AWS Lambda: Automated failover testing, health checks, and custom monitoring scripts

·        Large regulated financial-services delivery with formal change-control, audit and risk governance

·        Operational resilience expectations including RTO/RPO, multi-region DR and evidence for audit review

·        Awareness of applicable controls and regulations such as DORA, NIST CSF 2.0, PCI DSS, SEC cyber rules, RegSCI and SIFMU/FMI expectations where relevant

·        Ability to create Tech Risk-ready documentation including ADRs, runbooks, design docs, threat models and validation evidence

·        Clear communication with client engineering, security, SRE, data and platform stakeholders as an embedded SME

·        AWS Certified Data Engineer - Associate

·        AWS Certified Solutions Architect - Associate / Professional

·        AWS Certified Machine Learning - Specialty nice to have