Overview
On Site
$$65 / hr
Contract - W2
Contract - 1 day((s))
Skills
Data Engineer
Job Details
Job Description:
Requirement:
Requirement:
- Migrating the existing process by rewriting the JAVA SPARK process to SCALA SPRAK process.
- Responsible for creating airflow DAGS to migrate the jobs from existing legacy applications to Cloud (Google Cloud Platform).
- Responsible for design and developing the process to bring the data from different sources to Google Cloud Platform Parquet/Hudi format.
- Strong experience with data migration projects/ETL's, large scale DB's.
- Work with junior development team and be able to guide then on project architecture.
- Monitor Work loads, optimize resource usage, and recommend improvements for cost efficiency and performance optimization.
- Lead cloud migration initiatives, including rehosting, refactoring, and re-platforming legacy applications.
- Provide technical guidance and troubleshooting for cloud related issues.
- Proven experience as a Google Cloud Platform Architect or similar role in cloud computing.
- Strong expertise in Google Cloud Platform services, networking, security, and best practices.
- Knowledge of security, compliance, and identity management in the cloud.
- Familiarity with cloud cost management and optimization strategies.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Excellent communication and collaboration skills.
- Experience with data migration projects.
- Google Cloud Platform, Scala, SPARK, Google Cloud Platform, BigQuery, HUDI, Airflow and Oracle.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.