Senior Data Engineer with Scala, Spark, Big data

Big Data, Scala, Spark
Full Time
Depends on Experience
Travel not required

Job Description

Senior Data Engineer – Data Engineering


Duration: Fulltime Permanent Only

This position will support the company’s Digital Technologies & Analytics initiatives by taking a senior technical role in the development of advanced analytics capabilities and innovation

             Client is a leader in the spirits industry with a track record of profitability and growth

             Opportunity to help shape the Digital Technologies & Analytics initiatives

             Growth potential beyond this role

Outcomes/Success Criteria

             Drive the implementation of the defined innovation strategy through the design and architecture for analytics platform components/services utilizing Google Cloud Platform infrastructure and provide technical expertise to deliver advanced analytics

             Design, build & operate a secure, highly-scalable, reliable platform to consume, integrate and analyze complex data using a variety of best-in-class platforms and tools

             Collaborate with various global IT teams to develop Big Data reference architecture patterns for data ingestion, data processing, analytics and data science solutions

             Drive innovation through developing proof-of-concept’s and prototypes to help illustrate approaches to technology and business problems

             Provide strong technical skills with ability to design, architect, and get into low-level implementation details

             Be a hands-on developer and build scalable, real time, Big Data systems whilst providing a deep business understanding of CPG functions & processes

             Proven experience in working with globally distributing agile teams

             Develop and maintain modern development & data management methodology

Qualifications & Experience

(List NO MORE than 5 minimum requirements candidates must meet in order to be considered and NO MORE than 5 desired qualifications that you would ideally like to see in candidates.) 

             A bachelor's degree in computer science, math, physics, engineering or a related field

             2+ years of progressive experience in data and analytics, with at least 6 months experience in Google cloud platform

             Overall, 2+ years of progressive experience working in software engineering teams

             Experience with Google Cloud Platform technology stack for Data Analytics and Big data technologies (Big Query - DWH concepts, ANSI SQL, Big Table – HBase, DataProc – Spark/Hadoop, Dataflow – Apache Beam/Scala/Python) is required

             Experience in developing the data pipeline, ETL processes, data platform, data modelling, and data governance processes in delivering end-to-end solutions

             Solid foundation in design, data structures and algorithms, and strong analytical and debugging skills with customer-facing products experience

             Good understanding of private and public cloud design considerations and limitations in the areas of virtualization, global infrastructure, distributed systems, load balancing, networking, massive data storage, Hadoop, MapReduce, and security.

             Strong programming experience in Python and Scala

             Experience of using development tools like Eclipse and IntelliJ

             Experience of using Jenkins, GitHub flow and artifact repo.

             Experience developing real time data streaming pipelines

             Drive innovation by assessing, piloting, building DevOps/Cloud tooling and services to improve overall developer experience and productivity

             Expertise & experience in building large scale, cloud based and open source projects. 

             Hands-on solution driven attitude, with ability to turn around quick insights along with delivering strategic capabilities

             Multi-tasking ability to participate in multiple complex programs at the same time in an agile environment

             Strong organization and prioritization skills along with outstanding written and verbal communication skills

             Knowledge of agile software development methodology

Competencies – Organizational, Role Specific & Leadership


Organizational Competencies


             Entrepreneurial Approach

             Creating Innovative Solutions

             Beating the Competition Together


Role Specific Competencies


             Leading through Influence and Collaboration


             Commercial mindset

             Critical/Logical thinking

             Results oriented



Bineesh Nair


Biztech Solutions Inc

Dice Id : 10110076
Position Id : 6946364
Originally Posted : 2 months ago
Have a Job? Post it