Overview
Skills
Job Details
Must Haves:
- and either a Secret Clearance or ability to receive one (Costs are covered by the client)
- Reside in one of the above states
- 3 years of Prophecy experience
- 3 years of Databricks
Job Summary
Job Summary
The Senior Data Engineer (Prophecy) will be responsible for design and development of ETL. The role will cover full systems development life cycle (SDLC) phases including requirements gathering, data analysis, system design, development, implementation, and post-implementation support. During the design phase, the role will work closely with Data Architects/Models. The developer will be responsible the ETL movement of data from originating source feeds (files, x12, etc) to target systems (SQL Server, Snowflake) using Data Bricks.
Key Responsibilities
Key Responsibilities
- Collaborates with users, business analysts, developers, database administrators, and project managers on reporting needs.
Collaborates with data architect to create conceptual, logical, and physical data models for reporting databases.
Implements changes and provide post-implementation user support and system support.
Identifies and advocates beneficial change opportunities.
Acts as a technical resource for application and data users, data administrators and others.
Ensures compliance with TriWest HIPAA, privacy and government security policies.
Performs other duties as assigned.
Regular and reliable attendance is required.
Education & Experience
Required
- Bachelor's Degree in Business Administration, Computer Science, Mathematics, Engineering, or related field with programming and database systems coursework or equivalent database development experience
5+ years of experience in a Data Engineering role
2+ years of experience with Data Bricks preferably within Azure Cloud
3+ years of experience with Python
3+ years of experience with Azure
Experience in gathering business requirements from cross functional teams
Experience with SDLC processes and DevOps
Preferred
- Experience with Data Governance
Experience with SQL Server and Snowflake in Azure Cloud
Experience in ETL with both structured and semi-structured data
Experience with x12 data file formats
Understanding of ANSI and T-SQL
Experience with data analysis in the healthcare industry
Experience with Event Hubs and Change Data Capture (JSON)
Experience with cloud administration in Azure (ADLS2, DataBricks, Event Hubs)
Experience in a team or project lead role, with a focus on mentoring
Competencies
Technical Skills
Strong knowledge of data warehouse design; data modeling; proficiency with SQL; strong experience with data extraction, transformation, and loading (ETL); working knowledge of report and dashboard development; strong knowledge of SQL Server / Snowflake databases; working knowledge of Oracle databases.