Azure Data Engineer- (Databricks & Synapse)
Acumen Velocity
Dice Job Match Score™
🫥 Flibbertigibetting...
Job Details
Skills
- Microsoft Azure
- Databricks
- Synapse
- Migration
Summary
Job Summary:
We are seeking an experienced Azure Data Engineer with strong expertise in Azure Databricks and Azure Synapse Analytics to support a government data modernization initiative. The role involves migrating legacy Informatica PowerCenter ETL workflows to scalable, cloud-native Azure platforms and ensuring compliance with government standards and processes.
Key Responsibilities:
- Migrate Informatica PowerCenter workflows, mappings, sessions, schedules, and dependencies to Azure Databricks and Azure Synapse Analytics
- Design and develop scalable ETL/ELT pipelines using Azure Synapse Pipelines and Databricks
- Implement data transformations using PySpark, Delta Lake, and Delta Live Tables
- Modernize legacy ETL architecture using cloud-native Azure services and distributed processing frameworks
- Optimize and manage distributed data processing using Spark (Spark UI, Databricks job logs)
- Ensure data quality, security, and compliance with government standards
- Collaborate with stakeholders, architects, and business teams to define data solutions and best practices
- Troubleshoot, debug, and enhance performance of data pipelines
Required Skills:
- Strong experience with Azure Databricks (PySpark, Delta Lake, Delta Live Tables)
- Experience with Azure Synapse Analytics (Pipelines, Notebooks)
- Proven experience in ETL migration from Informatica PowerCenter to Azure
- Strong knowledge of Apache Spark and distributed data processing
- Proficiency in Python/PySpark and SQL
- Experience with data pipeline orchestration and debugging tools
Mandatory Requirement:
- Prior experience working on government/public sector projects
- Understanding of data security, compliance, and regulatory requirements in government environments
Preferred Qualifications:
- Experience with Azure DevOps (CI/CD pipelines)
- Familiarity with data warehousing and data lake architectures
- Experience working in Agile/Scrum environments
- Dice Id: 91171958
- Position Id: 9000688
- Posted 8 hours ago
Company Info
About Acumen Velocity
Acumen Velocity (Acumen Infotech LLC) provides cloud consulting, CRM implementation & Integrated productivity app implementation services to Healthcare and financial services companies.
Cloud consulting : We help application migration, data migration, data management & big data analytics via cloud solutions, API’s and platform architectures to help organizations leverage economies of scale via Google cloud platform solutions.
CRM implementation: We implement Hubspot, which is the worlds top automation platform for marketing and sales that is used by SAAS, small -and medium businesses. We help with campaign management, ad management, email marketing and contact management services & solutions on the Hubspot platform.
Productivity : Acumen provides implementation of productivity tools with GSuite. These include Gmail, Docs, Drive, Calendar, Meet for business. These tools are seamlessly integrated into the google cloud platform & the CRM to provide businesses with a 360 view of their marketing, sales, productivity and business apps.
Thus, we enable companies to operate in an agile & cloud integrated environment by leveraging - centralized security & management to improve security & efficiency by eliminating software & hardware purchases, licensing costs, administrative overheads & helping IT operate in an OPEX model rather than CAPEX.
Acumen Velocity is a Google cloud select partner in North America & a Hubspot Silver partner in North America.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs