Overview
On Site
Contract - W2
Contract - 6+ month(s)
Skills
data
GCP
FastAPI
Job Details
Job Summary:
We are seeking a talented Data Engineer with strong experience in FastAPI and a solid background in Google Cloud Platform (Google Cloud Platform) services. This role involves building scalable data pipelines, developing APIs, and leveraging Google Cloud Platform tools to support data infrastructure and analytics.
Key Responsibilities:
- Design and implement scalable data pipelines using Google Cloud Platform-native tools.
- Develop and maintain RESTful APIs using FastAPI for data access and integration.
- Work with large-scale datasets from various sources (structured and unstructured).
- Optimize data workflows for performance, scalability, and reliability.
- Collaborate with cross-functional teams including data scientists, analysts, and backend engineers.
- Ensure data quality, integrity, and security across all pipelines and systems.
Required Skills:
- Strong experience with FastAPI and general API development.
- Proficiency in Python and SQL.
- Hands-on experience with Google Cloud Platform services such as:
- BigQuery
- Cloud Storage
- Cloud Functions
- Pub/Sub
- Dataflow
- Composer (Airflow on Google Cloud Platform)
- Familiarity with CI/CD pipelines and version control (Git).
Preferred Qualifications:
- Experience with containerization (Docker, Kubernetes).
- Understanding of data governance and security best practices.
- Exposure to real-time data processing and streaming architectures.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.