Role: Azure Synapse & Data Engineer
Term: 18 months contract
Location: 100% Remote EST Candidate Only
Job Description
Platform Familiarity
Deep understanding of Azure Synapse Analytics architecture (SQL pools, Spark pools, pipelines)
Proficient in navigating Synapse Studio and managing workspaces
Experience accessing and managing Azure Data Lake Storage Gen2
Python & Spark
Maintain and debug PySpark scripts for ETL/ELT processes
Use Python libraries (e.g., requests, json, pandas) for data ingestion
Configure and tune Spark jobs for performance
SQL & Data Modeling
Write and optimize T-SQL queries
Create and manage views, stored procedures, and tables
Familiarity with data formats such as Parquet and Delta Lake
API Integration
Consume REST APIs with authentication (OAuth2, API keys)
Handle pagination, rate limits, and error responses
Parse and transform JSON responses
Schedule API calls via Synapse pipelines
Azure & DevOps
Use Azure Key Vault for secrets and credentials
Monitor jobs using Azure Monitor and Log Analytics
Access blob storage via Azure CLI or Storage Explorer
Manage code via Azure DevOps (branching, pull requests, versioning)
Deploy updates using CI/CD pipelines
Security & Access
Configure RBAC roles for data access
Manage private endpoints and VNet integration
Understand data governance and compliance requirements
Operational Support
Monitor pipeline health and job status
Respond to alerts and perform root cause analysis
Document workflows, dependencies, and escalation paths
Communicate with stakeholders and manage SLAs
Never miss an opportunity! Create an alert based on the job you applied for.
