Overview
Skills
Job Details
Duration: Long-term contract
Role Overview
NCDIT-T Web Systems is seeking a highly skilled Data Specialist with expertise in Azure Databricks to design and deliver advanced data solutions. The specialist will be responsible for data analysis, building aggregations, developing dashboards, and supporting reporting needs.
The ideal candidate will bring hands-on experience with Databricks (PySpark), SQL/Python, and visualization tools (Power BI and Databricks native visualizations). This role requires close collaboration with stakeholders, data engineers, and technical leads to ensure alignment between data solutions and business requirements.
Key Responsibilities
Perform comprehensive data analysis, create mappings, and ensure data quality and integrity.
Use Spark SQL in Databricks to query and analyze large datasets, writing efficient, complex queries.
Collaborate with data engineers to design and deliver high-quality data products.
Develop data mappings to support data integration and transformation from multiple sources.
Build Gold-layer data products for dashboards, APIs, and UI tools.
Create intuitive, interactive dashboards with Power BI or Databricks visualization tools.
Document pipelines, mappings, data models, and dashboard functionality.
Apply statistical analysis, data mining, and machine learning to identify insights.
Develop and deploy predictive models, algorithms, and advanced analytical tools to address business needs.
Required Skills & Experience
Azure Databricks (architecture, design, deployment, management) 3 years
Strong understanding of data science concepts (statistical learning, machine learning) 3 years
Proficiency in SQL & Python for queries, transformations, and dashboards 3 years
Experience with data modeling techniques (dimensional modeling, ER modeling, normalization/denormalization, Data Vault) 3 years
Excellent communication skills with ability to work cross-functionally and translate business needs 5 years
Preferred
Databricks Data Analyst Associate Certification
This role offers the opportunity to work on enterprise-level data solutions in a hybrid environment with the State of North Carolina. Candidates must be local to the Triangle region and available for occasional onsite work (up to 3 days/week).