Overview
On Site
Accepts corp to corp applications
Contract - Contract
Skills
SQL
Apache
GCP
Google Cloud
BigQuery
Healthcare
NiFi
Apache NIFI
Data Ingestion
Health
GCP Ecosystem
Apache NFL
Job Details
Position: Google Cloud Platform Data Engineer
Location: Hartford, CT
Duration: Contract
Job description:
- Design and implement real-time data ingestion pipelines using Apache NiFi, for structured and unstructured data.
- Integrate data pipelines with the Google Cloud Platform ecosystem (BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, Composer, etc.).
- Ensure low-latency, high-throughput data delivery to downstream systems for analytics and reporting.
- Develop and optimize SQL queries for BigQuery and relational databases.
- Write Python scripts for data transformation, automation, and custom NiFi processors when required.
- Implement data quality, validation, and error-handling mechanisms within ingestion pipelines.
- Collaborate with data analysts, data scientists, and platform engineers to deliver reliable datasets
- Ensure data security and compliance with Google Cloud Platform IAM, VPC Service Controls, and encryption standards.
- Monitor and troubleshoot pipeline performance issues and provide operational support.
- Document data flows, architecture, and best practices.
Required Skills & Qualifications:
- Proven experience with Apache NFL for real-time ingestion, routing, and transformation
- Strong knowledge of the Google Cloud Platform ecosystem
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.