Overview
Skills
Job Details
Need only local candidates
Job Summary
We are seeking a highly experienced AWS Data Architect Lead to drive the end-to-end design development and deployment of cloud data solutions This role will lead the migration of legacy Informatica ETL processes to a modern scalable Abased architecture ensuring performance reliability and cost efficiency
Key Responsibilities
Design and implement scalable event driven data pipelines using AWS services S3 Lambda Glue Airflow DynamoDB SNS
Define and enforce architectural standards data modeling practices and integration patterns
Lead the migration of ELT jobs from Informatica to AWS ensuring minimal disruption and high data fidelity
Provide technical leadership to cross functional teams including data engineers DevOps and QA
Collaborate with stakeholders to define data strategy roadmap and governance frameworks
Mentor junior architects and engineers fostering a culture of innovation and continuous improvement
Oversee the development of Python based ETL scripts and their integration into AWS Glue and Lambda
Ensure seamless orchestration and manage ETL workflows using Apache Airflow with DAG based scheduling and execution
Implement monitoring strategies using DynamoDB for job metrics and metadata tracking
Continuously optimize pipeline performance cost and scalability through automation and tuning
Enforce AWS security best practices including encryption IAM policies and audit logging
Integrate GitLab CICD pipelines with AWS Code Build to automate testing deployment and rollback
Promote DevOps and infrastructure as code practices for streamlined secure operations