Tekfortune Inc.
Tekfortune Inc.

Senior Data Engineer

Remote • Posted 2 hours ago • Updated 2 hours ago
Contract W2
No Travel Required
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Python
  • Pyspark
  • GCP (Google Cloud)
  • Dataproc
  • GKE (Google Kubernetes Engine)
  • Data Migration
  • Data Ingestion
  • SQL

Summary

Data Engineer (Python Hands-on)

Remote Role

6 month contract to hire

Must Have skill: Python, Spark, Google Cloud Platform (DataProc, GKE (Google Kubernetes Engine)), Data Migration, Data Ingestion

Overview: At a high level, they have migrated from Hadoop to Google Cloud Platform for data processing. Have a Google Cloud Platform data environment, predominantly for big data applications on the cloud. Seeking 3-5 Senior Level Data Engineers with strong Python skills to support ongoing data migration and ingestion efforts.

  • Source systems: get data from multiple external channels - provider data, healthcare groups, hospitals, etc. send data and their platform processes it and provides to operation systems.
  • Their end state is not a data warehouse for analytics - but the data directly feeds applications.
  • Currently, a lot of the data ingestion is being done manually and they are looking to automate.
  • Their data pipelines are PySpark, Scala/Spark run on Dataproc for larger volumes.
  • Python, Google Cloud Functions to execute the scripts with Google Kubernetes Engine (GKE)
  • Should have experience in working with denormalized data types, both structured and unstructured data.
  • Using Cloud SQL as relational cloud database, but okay with others i.e. Oracle, Postgres.
  • Building AI use cases as well - 5-6 use cases on their plate right now, including AI for data pipeline builds. Folks who can have some background in developing AI applications would be the ideal profile. If we found a strong ML or AI candidate with Python programming skills, they could potentially find a space for them.

Must Have:

  • Strong hands-on Python programming
  • Spark/PySpark
  • Google Cloud Platform (BigQuery, Dataproc, Google Cloud Functions, GKE, Cloud SQL - would not consider all must haves, just general awareness of the Google Cloud Platform ecosystem and data services)
  • Experience working with various data types and structures

Nice to Have:

  • AI experience - building AI systems, models, or building inference pipelines and processing data "for AI"
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90941404
  • Position Id: 9130687
  • Posted 2 hours ago
Contact the job poster
Verma Ankit

Verma Ankit

Tekfortune Inc. Recruiter @ Tekfortune Inc.

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
Remote jobs at Tekfortune Inc.