We are looking for Azure Data Lead for our client in New York City, NY.
Job Title: Azure Data Lead
Job Location: New York City, NY
Job Type: Contract
Job Overview:
Pay Range: $60.00hr - $65.00hr
Requirement/Must Have:
- Expertise in Python, OOP, and advanced Python design patterns.
- Proficiency in PySpark, Spark SQL, and SQL.
- Experience with Azure Databricks, Azure Data Factory, and ADLS Gen2.
- Knowledge of Apache Spark, Delta Lake, Data Lakehouse architecture, and distributed computing.
- Experience with MS SQL and Oracle PL/SQL.
- Proven experience as a senior data engineering leader with delivery of large-scale Databricks modernization programs.
Responsibilities:
- Analyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution.
- Design, develop, and deploy enterprise-scale data pipelines on Azure Databricks.
- Build reusable PySpark frameworks and utility modules.
- Implement Delta Lake solutions using the Bronze Silver Gold architecture.
- Build robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics.
- Implement data quality, reconciliation, validation, and monitoring frameworks.
- Optimize Spark jobs including partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, and Delta optimization.
- Benchmark converted applications against original Python implementations.
Nice to Have:
- Certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python.
Skills:
- Python.
- PySpark.
- Databricks.
- ADF.
- Data Lake.
- Spark SQL.
- SQL.
- ADLS Gen2.
- Apache Spark.
- Delta Lake.
- MS SQL.
- Oracle PL/SQL.
Qualification And Education:
- Strong verbal and written communication skills.
===
Benefits
Our Benefits Include:
- Medical, Dental, and Vision Insurance
- 401(k) Retirement Plan
- Health Savings Account (HSA)
- Disability Insurance (Short-Term and Long-Term)
- Life and AD&D Insurance
- Paid Sick Leave (where required by applicable state or local law)
- Supplemental Insurance Plans
- Identity Theft Protection
- Pet Insurance
- Employee Wellness Programs
- Employee Assistance Program (EAP)
- Career Growth and Professional Development Opportunities
Disclaimer: Benefits eligibility, accrual rates, and usage limits may vary based on employment status, length of service, and work location. Paid Sick Leave is provided in strict accordance with applicable state and municipal mandates. Cynet Systems Inc. reserves the right to modify, amend, or terminate any benefit plans at any time in accordance with applicable laws.
About Cynet Systems
Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading technology staffing and workforce solutions company serving Fortune 500 companies, government agencies, and enterprise organizations across the United States and Canada. We deliver agile, scalable talent solutions across IT, engineering, life sciences, clinical, and professional staffing, powered by a high-performing recruitment engine operating across North America and Asia.
As a nationally and locally certified Minority Business Enterprise (MBE), Cynet Systems is committed to helping organizations build high-performing teams while empowering professionals to grow rewarding careers. Our organization is certified to ISO 9001, ISO 14001, ISO 27001, and SOC 2 Type II standards, reflecting our commitment to quality, security, operational excellence, and customer success.
Never miss an opportunity! Create an alert based on the job you applied for.
