Duration: 6+ Months
They are looking for AWS /BigData Architect with experience on Athena ,EMR ,Data Lakes
We need someone with Data Lake experience who can help us to improve overall architecture.
- Provide recommendations on ways to improve current architecture and reduce the overall cost.
- Provide recommendations on S3 bucketing strategy, and security setup best practices.
3. Review current ETL design(ingestion, execution, orchestration, auditing, and logging) and share industry best practices to help improve the overall design.
4. Define the DevOps strategy (CI/CD)
5. Active Directory(SSO) integration with AWS services (Lake Formation and Quicksight)
6. Define end to end lake formation strategy
7. Define and implement Disaster Recovery strategy
- EMR cluster management (instance fleet)