Overview
On Site
$90 - $95
Contract - W2
Contract - 9 Month(s)
75% Travel
Skills
API
Amazon Web Services
Cloud Computing
Artificial Intelligence
Machine Learning (ML)
Terraform
Systems Design
Python
Version Control
Big Data
Data engineering
Pipeline
Modeling
Job Details
Note: This role is on W2 Basis only.
Client: Oil and Gas Industry
Job Description:
- The Senior Python Data Engineer will contribute to the development of a scalable, high-performance data and AI platform using Amazon Web Services (AWS). The ideal candidate will combine strong software engineering principles with deep expertise in cloud platform engineering to build robust data and AI platform that drive business insights and decision-making.
Responsibilities include:
- Work directly with Data Scientists to develop high quality, reliable, scalable, machine learning systems
- Design and implement frameworks and tools to streamline the machine learning process
- Automate manual ML pipelines including model training, registration, promotion, and inferencing
- Leverage software architecture and design patterns to develop fault tolerant software components
- Convert research-based machine learning models into production-ready software
- Implement processes to ensure coding standards, code quality, documentation, and test coverage
- Design and implement cloud-native architectures following AWS best practices for security, scalability, and cost optimization
- Implement Infrastructure as Code (IaC) using tools like CloudFormation, Terraform, or CDK
- Establish CI/CD pipelines for platform deployments and automated testing
The successful candidate will meet the following qualifications:
- 5+ years of programming experience in Python building large, distributed, mission critical systems
- Expertise in developing and maintaining data pipelines
- Experience in testing, packaging, and deploying machine learning models
- Experience in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control.
- Experience in designing modular, reusable software components
- Experience in developing API endpoints and microservices
- Knowledgeable of MLOps Principles
- Knowledgeable of Knowledgeable of AWS data and AI services including Sage Maker, Lake Formation, Glue, and Athena
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.