Overview
Remote
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
AWS
Python
SQL
Spark
S3
Glue
Athena
Glue Data Catalog
Lake Formation
Quicksights
CloudWatch
Job Details
Over 8 Years of Experience as AWS Cloud Engineer.
Must-Have Skills & Experience among all of the candidates
- Advanced Python Engineering Skills
- Strong proficiency in Python for data engineering tasks.
- Experience with modular, testable code and production-grade pipelines.
- Not looking for SQL-heavy only DBAs, this is a software engineering role.
- AWS Lakehouse Architecture Expertise
- Proven experience designing and implementing lakehouse architectures on AWS.
- Familiarity with key AWS services: Spark, S3, Glue, Athena, Glue Data Catalog, Lake Formation, Quicksights, CloudWatch, etc.
- Experience with BI analytics solutions like AWS Quicksights(Preferred), Tableau or Cognos
- Python based ETL Pipeline Development
- Experience with DAG frameworks like Argo Workflow(preferred) or Airflow
- Experience with running/building workloads on EKS
- Open Table Formats
- Deep understanding of Apache Iceberg (preferred), Delta Lake, or Apache Hudi.
- Experience implementing time-travel, schema evolution, and partitioning strategies.
- Medallion Architecture Implementation
- Experience designing and implementing Bronze Silver Gold data layers.
- Understanding of ingestion, transformation, and curation best practices.
- Slowly Changing Dimensions (SCD Type 2)
- Solid grasp of SCD2 semantics and implementation strategies in distributed data systems.
Thanks and Regards,
Aju
Shakti Group Inc
Phone:
Email:
Fax:
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.