Data Engineer

Overview

Remote
Depends on Experience
Contract - Independent
Contract - W2
No Travel Required

Skills

Apache Airflow
Apache Spark
Cloud Computing
Data Integration
Data Migration
Data Warehouse
Database
Extract
Transform
Load
Google Cloud
Google Cloud Platform
IoT
Java
Microsoft SQL Server
Microsoft SSIS
Python
SQL
Stored Procedures
Streaming

Job Details

Candidate Submission Details

Candidate Name

Phone

Email ID

LinkedIn

Skills

Total Years Of Experience

Interview Date / Time (availability)

Work Authorization (If H1 validity date)

Hiring Level for FTE/CW

Contractor Rate/Salary

Previously Worked With Brillio, Yes/ No

Candidate employee company name

Referral Employee ID

Current Location

Willing To Relocate /Travelling

Availability to Start

Title : Lead Data Engineer

Location : 100% Remote

Pay Rate : $60/hr c2c or 1099

Client : thru Brillio

Required Skills:

  • Google Cloud Platform
  • Google BigQuery
  • Apache Airflow
  • Python
  • SQL
  • DBT

Data Engineer:

1.Data Migration:
Good knowledge in data warehousing technologies like Google BigQuery
Experience with cloud platforms like Google cloud environment.
Analyze source data warehouse and migrate to Google BigQuery
Need to Migrate data from diverse sources like SQL Server, on-premises databases to Google BigQuery.

2.Data Integration:
Connecting and integrating data from different sources, including APIs and databases.

Good knowledge on IoT data streaming process and handling them in large scale environments .

3.ETL/Data Pipeline Development:
Analyze the existing SSIS packages and develop ETL pipelines for the required transformation.
Create ETL pipelines using tools like Apache Airflow or Python or spark to transfer data to BigQuery.

4.Programming Skills:
Develop SQL-based tables/views and queries for efficient data retrieval and analysis within BigQuery scheduled queries
Analyze complex stored procedures and design solutions in the Google BigQuery.
Experienced in developing code/pipelines for data transformation using Python, SQL, Java & Spark.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Think Big Solutions, Inc