Data Ingestion Engineer

Overview

Remote
Depends on Experience
Contract - Independent
Contract - W2
Contract - 6 Month(s)
No Travel Required

Skills

Jira
DBMS
SQL
DB2
Oracle
API
SOAP
Confluence
Google Pub/Sub
Big Query
Google
Google Dataform
Google Data Fusion
Data Ingestion
Google Cloud Storage
Cloud Composer
GitHub

Job Details

Data Ingestion Engineer/Analyst - Remote

Contract Duration: Initially 6 months with potential extension based on performance.

Are you ready to dive into complex data ingestion processes on the Google Cloud Platform? Our client is seeking a skilled Data Ingestion Engineer/Analyst to join their team. If you're adept at implementing data workflows and troubleshooting existing processes, we want to hear from you!

Position Purpose: Implement simple to complex data ingestion processes on Google Cloud Platform using industry-standard best practices. Design, develop, configure, test, debug, and document these processes based on business requirements and technical architecture specifications. Support and troubleshoot existing ingestion processes and data.

Responsibilities:

  • Design and implement data ingestion workflows according to business needs and technical specifications.
  • Work independently and collaboratively with the team, keeping project team and leaders informed.
  • Prepare detailed specifications for the development of data ingestion processes.
  • Develop and implement technical solutions through code development and tool configuration.
  • Query databases using SQL to extract relevant data for analysis and troubleshooting.
  • Develop and execute testing and implementation plans, documenting results.
  • Participate in project planning and development or assume responsibility for a project of limited scope.
  • Provide options for and estimate possible coding.
  • Estimate and track time required to complete work for project budgeting and financial tracking.
  • Conduct and participate in reviews of solution designs, configurations, and code.
  • Provide technical expertise for project and baseline support teams.
  • Adhere to security standards and development standards.

Education Level: Bachelor's Degree (4-Year)

Years of Experience: 3+ years of professional experience

Technical Skills and Qualifications:

MUST HAVES:

  • Google Pub/Sub
  • BigQuery
  • Google Dataform or Google Data Fusion (experience with either, both preferred)
  • Data ingestion to BigQuery
  • Google Cloud Storage
  • Cloud Composer
  • GitHub
  • SQL

Good to have:

  • Experience with DBMS connectivity and interaction (SQL Server, DB2, Oracle)
  • Experience calling RESTful APIs and SOAP Web services
  • Experience integrating with other Google resources, databases, and services
  • Jira
  • Confluence

While working remotely, candidates must have reliable high-speed internet.

If you're ready to take on this exciting role and contribute to their team's success, apply now!