Lead Data Engineer

Our client is looking Lead Data Engineer for Long Term Contract project Santa Clara, CA (Onsite) below is the detailed requirements.

Job Title : Lead Data Engineer

Location : Santa Clara, CA (Onsite)

Duration : Contract

Job description:

• Bachelor's degree in Computer science or equivalent, with minimum 10+ Years of Overall IT experience.
• Should have Cloud Platform Expertise (Google Cloud Platform Focus): Extensive hands-on experience working in dynamic cloud environments, with strong preference for Google Cloud Platform (Google Cloud Platform) services.
• Should have expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
• Must have experience with other relevant Google Cloud Platform services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub.
• Should have Expert-level programming proficiency in Python, including experience with relevant data engineering libraries.
• Must have a solid command of advanced SQL for complex querying, data processing, and performance tuning.
• Extensive experience on Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Dagster, or similar).
• Strong understanding of DevOps principles and practices.
• Should have Experience with CI/CD pipelines, automation tools, and deployment strategies.
• Should be Familiar with version control systems (Git) and tools like GitLab CI/CD, GitHub Actions, or Jenkins.
• Must have Knowledge of containerization (Docker) and orchestration tools (Kubernetes) is a plus.
• Should have the ability to implement monitoring solutions and automate operational tasks to ensure reliability and scalability.
• Excellent communication and teamwork skills. Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customers.
• Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail.