Job Summary:
-
Role: Analytics Platform Engineer (Azure & AWS Databricks, DevOps focus)
-
Location: Applicants must be local to specified locations - san Francisco, CA or Dallas, TX or Hopkins, MN or Charlotte, NC or Atlanta, GA locals
-
Employment Type: W2 only (No Sponsorship available)
Responsibilities:
- Design, implement, and maintain CI/CD pipelines for data pipelines and infrastructure using Gitlab, Azure DevOps, or GitHub Actions.
- Develop automation using Terraform modules or other IaC tools to deploy and manage Databricks Workspaces and other cloud resources.
- Provision and manage Azure Analytics services (Databricks, Synapse Analytics, Data Factory, ADLS, Azure Monitor) using Infrastructure as Code (Terraform, ARM, Bicep).
- Deploy, operate, and optimize Azure data services, including performance tuning, monitoring, and troubleshooting.
- Automate routine operational tasks and deployments using scripting languages (Python, PowerShell, Bash).
- Implement security best practices, including IAM, encryption, and data governance compliance (e.g., GDPR).
- Collaborate with data engineers, data scientists, and business analysts to deliver robust technical solutions and foster a DevOps culture.
Key Skills & Qualifications:
- Deep expertise in Microsoft Azure and/or AWS cloud services, especially Databricks.
- Proficiency with DevOps tools: Gitlab, Azure DevOps, GitHub Actions, Git, and branching strategies.
- Strong experience with Infrastructure as Code (Terraform, ARM, Bicep).
- Experience with Docker and container orchestration (AKS) highly beneficial.
- Proficiency in programming and scripting languages (Python, SQL, PowerShell, Bash).
- Understanding of Data Engineering fundamentals (ETL/ELT, data modeling, data warehousing, big data).
- Experience with monitoring, logging, and alerting tools (Azure Monitor, Log Analytics, App Insights).
- Excellent problem-solving, analytical, and communication skills; ability to work in agile environments.
- Preferred certifications: Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400).