Overview
On Site
Hybrid
$$75/hr-$80/hr
Accepts corp to corp applications
Contract - W2
Contract - 6 Month(s)
Skills
Azure
Spark
Data Engineer
PYspark
ADF
SparkSQL
Job Details
Principal Data Engineer -53328
We have an immediate long-term opportunity with one of our largest clients for a position of Principal Data Engineer, to work in Bellevue WA
Responsibilities:
- Utilize Azure services including ADF for orchestration, ADLS for storage, and AzureDevOps for CI/CD.
- Design, develop, and maintain ETL processes leveraging Databricks and Spark.
- Write and maintain PowerShell scripts for automation tasks.
- Utilize SQL (TSQL, PostgreSQL) for data manipulation and querying.
- Work with parquet and delta formats for efficient data storage and processing.
- Follow SDLC and CI/CD practices, including peer-reviewed code deployments.
- Optimize code for performance, including understanding indexes, partitioning, and resource utilization.
- Write code that can be executed repeatedly and produce consistent results.
Qualifications:
- Overall 13-18 Years of Experience with 8-10 years of experience as a Data Engineer.
- Minimum 6 years of experience with Azure, ADF, Databricks, and Spark.
- Proficiency in PowerShell scripting.
- Strong SQL skills, including TSQL and PostgreSQL.
- Experience with parquet and delta formats.
- Understanding of SDLC and CI/CD processes.
- Ability to optimize code for performance and scalability.
For more information please connect with
Nixondas
PRIMUS Global Services
Direct
Desk Ext: 218
Email: