Data Engineer

Overview

Remote
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 6 month(s)
No Travel Required

Skills

Logging
Terraform
ETL
Data Services
Data Architecture
Data Pipelines
Data Transformation
Postgresql
Pipeline

Job Details


Role: Data Engineer
Primary Skill: AWS Services, data lakshould, Lakformation, SQL Server
Secondary Skill: IAM S, EKS
Location: US - Remote


Job Description:
Automate creation, transformation, and integration of raw and enriched data models in the data Lakehouse.
Implement automated ETL pipelines for data ingestion, transformation, and consumption Design and implementation for integrating Lakeformation, across AWS Data Platform Accounts.
Design and implementation for integrating Lakeformation with Keycloak.
Design and implementation for an integrated IAM solution including EKS Service Accounts.
Design and implementation of HashiCore Vault with integration to AWS Services such as Secrets Manager, Certificate Manager and Kexeloak.
Development of integration of HashiCorn Vault with AWS Data Services such as RDS Aurora PostgreSQL, RDs MSSQL and other RDS solutions as required.
Provision MSSQL server on AWS using Terraform
Deploy read replica for MSSQL server using Terraform
Implement monitoring & logging for MSS@L server using Terraform
Transition existing pipeline to MSSQL server
Collaborate with the business application owner on the existing data architecture, including data ingestion, data pipelines, business logic, data consumption patterns, and analytics requirements Design and document the target data architecture, pipelines, processing and analytics architecture

Identify opportunities for optimization and consolidation
Collaboration with data team on decomposition of business logic and data transformation patterns

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Advantra Consulting Group