Job Description:
Pay Rate: $70/hour - $75/hour on W2
Must Have Skills / Requirements
1) Experience with AWS data services: Redshift, RDS/Aurora PostgreSQL, S3, EC2, Athena, Glue, Lake Formation
a. 3+ years
2) Experience with Databricks: workspace administration, Unity Catalog, cluster management, Spark SQL, Delta Live Tables or similar
a. 2+ years
3) Experience with PostgreSQL or Aurora PostgreSQL: query tuning, replication concepts, pg_stat views, parameter groups
a. 2+ years
4) Experience with AWS =Security: IAM (Users, Groups, Roles, Policies, Instance Profiles), Redshift/RDS security, S3 bucket policies
a. 2+ years
Nice to Have Skills / Preferred Requirements
1) PySpark for data pipeline development
2) AWS Glue with Iceberg or Delta Lake integration
3) Snowflake administration
4) Terraform or AWS CDK for infrastructure as code
5) DynamoDB experience
6) Feature Store
Soft Skills:
1) Ability to read, understand, debug, and extend complex Python codebases; comfort navigating large repositories with multiple modules and abstractions
2) Strong analytical and critical thinking skills
3) Ability to lead projects, prioritize, and multitask
4) Deadline and detail-oriented
5) Part of on-call rotation
Technology Requirements:
1) Experience with Apache Iceberg on S3: partition management, compaction, snapshot management, schema evolution
2) Proficiency in Python for automation and shared tooling: object-oriented design, writing maintainable and testable code, participating in code review, and contributing to a shared Git-based codebase
3) Experience automating database and platform operations using Python, Jenkins, Airflow, Datadog and Git