Overview
Remote
$44 - $54
Contract - W2
Contract - 12 Month(s)
No Travel Required
Skills
Amazon Redshift
Extract
Transform
Load
Python
Google Cloud Platform
SQL
Datastage
Snap Logic
BigQuery
Data Warehouse
IBM InfoSphere DataStage
Job Details
Required Skills
Google Cloud Platform experience building data pipelines (ETL) from scratch building data workflows Python SQL
Job Description
migration of data to Google Cloud Platform, building out the Google Cloud Platform BigQuery warehouse (and moving data from Redshift into it), sunsetting legacy ETL (Datastage) and replacing with various new data ingestion solutions.
- Experience in SnapLogic is strongly preferred; they have found this to be more amenable to upskilling.
- Needs experience in Airflow or Cloud Composer orchestration, development of new DAGs from scratch.
- Development of data ingestion and ETL pipelines from scratch. Using SnapLogic primarily for data pipelines and integrations, but also Python, SQL, Dataflow, Spark.
- Needs experience in data warehousing, Google BigQuery.
- Not responsible for building out visualizations; another team handles
- Will be supporting data modeling, but not owning. Should have some experience in data modeling, data warehousing fundamentals.
- Understanding of analytics as a whole, how data moves from source, warehouse, semantic or reporting layer, models, and reporting/BI, but their hands-on focus will be around building data pipelines and orchestration.
- Proactive communicators, inquisitive people, problem-solvers, unafraid to make suggestions, ask questions. "Order taker" and "heads down" types of Engineers will not be a culture fit for the team.
- They have a list of other technologies in their environment in smaller amounts/more dispersed--any would be a "nice to have": i.e. Kafka, Java, Apache Beam, Alteryx, etc.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.