Overview
Hybrid
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)
No Travel Required
Able to Provide Sponsorship
Skills
AWS
R Shiny Apps
AWS Glue
AWS Crawler
AWS Athena
Azure Data Factory
Databricks
Medallion Architecture
Job Details
Data Science/Data Engineer:
We are looking for an experienced Data Engineer, to participate in a cloud infrastructure project and maintain AWS Cloud infrastructure, maintain crucial telematics ETL processes, build utility monitoring tables, create users, policies and permission sets.
Must Have: R Shiny Apps, AWS Glue, AWS Crawler, AWS Athena, Azure Data Factory, Databricks, Medallion Architecture
- Maintain SageMaker docker backed RStudio infrastructure to enable data scientists to spin as much compute as they need.
- Work on MS Azure AI Foundry, selecting, deploying, testing, fine-tuning and policing AI models for the advanced analytics team.
- Migration to MS Azure for applications, middleware, and API
- Develop and deploy R-based Shiny Apps for interactive data visualization and user-facing applications.
- Design and implement backend data processing workflows using AWS Glue for serverless compute, AWS Crawler for data cataloging, and AWS Athena for querying data lakes.
- Write efficient, maintainable code in Python, R, and SQL to support data ingestion, transformation, and analysis.
- Orchestrate and automate complex data pipelines using Azure Data Factory to ensure seamless data flow across systems.
- Leverage Databricks for big data processing, implementing Medallion Architecture to ensure data quality and scalability.
- Collaborate with cross-functional teams to translate business requirements into technical solutions.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.