Data Engineer

Data Engineer

US - Remote

FTE - Citizenship required.

My client, a leading firm in the insurance sector, is hiring for a Data Engineer role. The company focuses on innovative data strategies to achieve its strategic business objectives. The position involves leading the development of data platforms and reporting solutions essential for enterprise analytics. Key responsibilities include designing data architecture, building data pipelines, and implementing best practices to support business goals through effective data solutions.

Responsibilities:

• Leverage Azure SQL Databases and Azure Data Factory to create solutions. Use Databricks for Spark development, including Notebooks, and work with R, Python, or Scala. Collaborate with iPaaS tools (such as Mulesoft and Informatica) and other data ingestion technologies.


• Create and implement dimensional, relational, and 3NF data models. Design conceptual, logical, and physical data models to meet business needs.


• Oversee source control, including branching, merging, and pull requests. Apply CI/CD practices for continuous integration and deployment. Perform integration and unit testing to maintain data quality and ensure reliability.


• Design and manage ETL and ELT workflows. Build batch, micro-batch, and real-time pipelines to seamlessly integrate data systems.


• Build data layers similar to Medallion architecture to support a data lakehouse. Facilitate enterprise BI, advanced analytics, and machine learning efforts.


• Develop near-real-time operational data stores. Design systems that support operational reporting and seamless application integration.

Requirements:

• BS in Data Science, Comp Sci, or related. Graduate degree preferred.


• 5+ years of experience in Data Engineering positions


• Experience in Azure, SQL, Python, Power BI


• Strong ETL/ELT dev experience


• Strong cloud experience is a must


• Great communication skills.