Lead Data Engineer
Contract Independent
Contract W2
12 Months
No Travel Required
On-site
Depends on Experience
CogniSoft Technologies
Fitment
Dice Job Match Score™
🫥 Flibbertigibetting...
Job Details
Skills
- Health Care
- Data Warehouse
- Databricks
- DevOps
- ELT
- Extract, Transform, Load
- Data Management
- Data Manipulation
- Data Modeling
- Continuous Delivery
- Continuous Integration
- Data Integration
- Access Control
- Business Intelligence
- RBAC
- Regulatory Compliance
- Microsoft Power BI
- Migration
- Optimization
- PySpark
- Information Systems
- MicroStrategy
- Microsoft Azure
- Python
- Communication
- Computer Science
- Data Quality
- Git
- Mentorship
- SQL
- Science
- Systems Analysis/design
- Terraform
- Unity
- Workflow
Summary
Position : Lead Data Engineer
Location : Charlotte NC 28273
Duration : 12+ Months
Must Have:
They must have very strong Data Bricks experience using the latest version
Good communication skills
Leading a team of data engineers
Power BI and MicroStrategy experience highly preferred
Reporting platform will be Power Bi
Position Description (the more details the better)
Lead Data Engineer
Large Healthcare organization is seeking a lead Data Engineer to join their expanding team
This is What You’ll Do
- Lead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake
- Enhancement of CI/CD pipelines and Azure DevOps, Git, and automated deployment frameworks to streamline development and release processes
- Ensure data quality and consistency through data integration, transformation, and cleansing
- Familiarity with security and governance best practices using Unity Catalog, Azure RBAC, managed identities, and data access controls to ensure compliance and secure data management is preferred
- Responsibility includes leading a team of data engineers and mentoring in best practices.
- Utilize Python for data manipulation, automation, and custom data solutions
- Collaborate with stakeholders to understand data needs and translate them into technical solutions
- Participate in on-call rotation and assist with after-hours issues, as required
- Perform other duties as assigned
This is What it Takes
- Bachelor’s degree in computer science or information systems science, or equivalent experience
- Three (3) years’ experience with Azure Databricks platform
- Five (5) years of comprehensive data warehouse analysis and design experience, with full knowledge of data warehouse methodologies, data modeling and familiarity with operational data stores.
- Five (5) years of experience with ETL/ELT Development, Python, PySpark
- Python, SQL, and Terraform experience
Required Certifications, Licenses, and Registrations
- Databricks Data Engineer Professional or Databricks Data Engineer Associate Certification preferred
Knowledge, Skills, and Abilities
- Ability to adapt to changing priorities and respond to problems creatively
- Ability to assist clients with migrating from legacy to modern data platform
- Proficiency with technical, conceptual, interpersonal, written, and verbal communication skills
- Knowledge of general business, quality and regulatory requirements preferred
- Familiarity with Power BI and MicroStrategy architecture is a plus
Key Skills / Words: (at least 6)
Data Engineer
Power BI
MicroStrategy
DataBricks
Python
PySpark
Computer science
Information technology
SQL
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10527831
- Position Id: 9032146
- Posted 3 days ago
Company Info
CogniSoft Technologies focuses on providing niche Business Intelligence & Data Analytic solutions to businesses across various industries. We are Tableau Alliance Partners. We are also an SAP certified Company.
We are a team of experienced, dedicated, hardworking, and innovative professionals who have had proven their expertise in different business verticals such as Banking and Financial Industry, Healthcare, Supply chain, Insurance, Software Development, IT consulting, Business consulting etc.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs