Overview
On Site
Full Time
Skills
Big Data
Algorithms
Data Quality
Process Improvement
Scalability
Extraction
Amazon Web Services
Extract
Transform
Load
Software Engineering
Data Mining
Fluency
Python
SQL
Database Design
Apache Hive
Data Warehouse
Dashboard
Tableau
Grafana
Databricks
Analytical Skill
Computer Science
Job Details
Software Engineer
REMOTE
Duration: 12 months plus extensions
We are looking for an experienced software engineer (contract) to join our team. The software engineer will support our ongoing initiatives within infrastructure automation projects. The engineer with work closely with three SWEs, a data scientist, capacity planners and others to deliver applications mainly in big data and infrastructure domains. You will pull data from various data sources, transform and apply algorithms to produce results which will have a high business impact.
To succeed in this SWE position, you should have strong analytical skills and the ability to combine data from different sources with SQL/Python.
Responsibilities:
- Build data systems and pipelines
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Develop analytical tools and programs, and build dashboards
- Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Building ETL jobs for optimal extraction, transformation and loading of data from various data sources using AWS, Airflow, Databricks and SQL technologies.
- Building analytical tools to utilize the data pipeline, providing actionable insights into key infrastructure metrics and performance
Requirements
- Previous experience as a SWE engineer or in a similar role
- Technical expertise with data models, data mining, and segmentation techniques
- Fluent in python
- Hands-on experience with SQL database design and experienced to work with hive/databricks or other data warehouses
- Have experiences to build dashboards on Tableau/Grafana/Databricks
- Experiences on building data pipelines on Airflow is a plus
- Great numerical and analytical skills
- Degree in Computer Science, IT, or similar field
REMOTE
Duration: 12 months plus extensions
We are looking for an experienced software engineer (contract) to join our team. The software engineer will support our ongoing initiatives within infrastructure automation projects. The engineer with work closely with three SWEs, a data scientist, capacity planners and others to deliver applications mainly in big data and infrastructure domains. You will pull data from various data sources, transform and apply algorithms to produce results which will have a high business impact.
To succeed in this SWE position, you should have strong analytical skills and the ability to combine data from different sources with SQL/Python.
Responsibilities:
- Build data systems and pipelines
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Develop analytical tools and programs, and build dashboards
- Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Building ETL jobs for optimal extraction, transformation and loading of data from various data sources using AWS, Airflow, Databricks and SQL technologies.
- Building analytical tools to utilize the data pipeline, providing actionable insights into key infrastructure metrics and performance
Requirements
- Previous experience as a SWE engineer or in a similar role
- Technical expertise with data models, data mining, and segmentation techniques
- Fluent in python
- Hands-on experience with SQL database design and experienced to work with hive/databricks or other data warehouses
- Have experiences to build dashboards on Tableau/Grafana/Databricks
- Experiences on building data pipelines on Airflow is a plus
- Great numerical and analytical skills
- Degree in Computer Science, IT, or similar field
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.