Hi
Hope you doing good.!
Position : Sr Data Engineer.
Hybris :Local to bay area 1 day onsite a must
Strong Python and Pyspark
Good with Data Structures and algorithms
15+yrs experience required
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Provide technical support and usage guidance to the users of our platform s services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams..
Proficiency working in Linux environment
working knowledge of SQL, Python, and PySpark
Git/Bitbucket, Jenkins/CodeBuild, CodePipeline