WS Database Architect

Overview

On Site
Depends on Experience
Contract - W2
Contract - Independent

Skills

Amazon Web Services
Database
Apache Spark
AWS
SQL
scala

Job Details

The role demands expertise in database management, SQL query optimization, cost efficiency, and data pipeline orchestration, with hands-on proficiency in Databricks and AWS services. The ideal candidate will collaborate with data engineers, analysts, and DevOps teams to deliver robust, cost-effective solutions.

Key Responsibilities:

  • Design scalable AWS cloud architectures focused on storage efficiency and orchestration.
  • Optimize SQL queries and database performance for AWS databases (RDS, Aurora, Redshift) using execution plan analysis and indexing.
  • Develop CI/CD pipelines for data and infrastructure automation with tools like GitHub Actions or AWS CodePipeline.
  • Implement cost optimization strategies using AWS Cost Explorer, Savings Plans, and resource rightsizing.
  • Build and manage Databricks notebooks for data pipelines, analytics, and ETL processes with Spark optimization.
  • Orchestrate workflows using AWS DAGs via Airflow/MWAA.
  • Sync metadata between AWS Glue Data Catalog and Unity Catalog (Databricks) for seamless data governance.

Required Skills

  • 8-10 years in cloud and database architecture.
  • Hands-on expertise in SQL query optimization and performance tuning for relational databases.
  • Proficiency in AWS Glue, S3, Lambda, Step Functions, and MWAA.
  • Experience with Databricks, Unity Catalog, and Spark-based notebook development.
  • Skill in building CI/CD pipelines using GitHub Actions, AWS CodePipeline, or Jenkins.
  • Knowledge of cloud cost optimization techniques, including Reserved Instances.
  • Strong coding skills in Python, SQL, or Scala.
  • Expertise in AWS orchestration and storage management (e.g., S3 lifecycle policies).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.