Job ID: NC-814178
Hybrid/Local Databricks Data Analyst with PySpark, Spark SQL, Power BI, statistical analysis, data mining, ML experience
Location: Raleigh, NC (NCDIT)
Duration: 6 Months
Skills:
Databricks and PySpark proficiency: hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation. Required 5 Years
Advanced Spark SQL: the ability to write efficient, complex queries to analyze large datasets within Databricks. Required 5 Years
Data visualization and dashboarding:building clear, intuitive dashboards in Power BI and Databricks’ native visualization tools to communicate insight Required 5 Years
Data mapping and modeling: developing detailed mappings that integrate and transform data Required 5 Years
Business requirements and stakeholder collaboration: gathering and developing business requirements Required 5 Years
Data quality and analysis: conducting thorough data analysis Required 5 Years
Description:
Data Analyst
This is a hybrid position. The manager is unsure how often he will need the contractor onsite, but the maximum requirement would be three days a week on Tuesday, Wednesday, and Thursday.
The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating with stakeholders to ensure alignment between data solutions and business needs. You will work closely with a technical lead and participate in design discussions and planning with the broader development team.
Key Responsibilities
Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
Collaborate closely with data engineers to design and deliver high-quality data products
Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
Design and build intuitive, informative dashboards using tools such as Power BI or Databricks’ native visualization tools to effectively communicate insights
Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights
