Overview
Skills
Job Details
Job Title: Sr Data Engineer(w2 position)
Duration: 12+ Months
Location: Houston, TX (Onsite)
Description:
We are currently seeking a Data Engineer with 10+ years experience to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Data Engineer will work closely with the Data Science team and Business functions to solve real-world oil and gas midstream problems using machine learning, data science and artificial intelligence. This individual will provide technical and thought leadership to the team to build out a data engineering practice within the organization.
Must Have Skills
Python Pandas, Numpy, Pytest, Scikit-Learn
SQL
Apache Airflow
Kubernetes
CI/CD
Git
Test Driven Development (TDD)
API development
Knowledgeable of Machine Learning
Responsibilities
Create, test, and maintain data pipeline architectures
Work independently on analytic projects for multiple business functions
Automate manual data flows for repeated use and scalability
Develop data-intensive applications with API's
Develop algorithms to transform data into useful, actionable information
Operationalize mathematical models and machine learning models
Assist data analysts and data scientists with data processing automation and deployment