Senior Data Engineer
SUMMARY The Senior Data Engineer position works cross-functionally with business domain experts, analytics and engineering teams to design and implement a new Data Warehouse. This position designs, implements and scales data pipelines transforming billions of records into actionable data models enabling actionable insights. The role leads initiatives to formalize data governance and management practices and rationalizes the information lifecycle and key company metrics. This position provides mentorship and hands-on technical support to build trusted and reliable data sources. With an emphasis on effective collaboration with key stakeholders, the Senior Data Engineer is responsible for the assessment of business requirements, collection and identification of technical specifications and the subsequent development of technical solutions. The Senior Data Engineer is a key contributor to the successful delivery of business intelligence information to the entire organization. This role is experienced in: Cloud Infrastructure ETL (Extract Transform Load) Processes & Implementations Cloud Services (S3, Athena and Glue) Dashboard Architecture Redshift & Snowflake Data Warehouses Data Pipelining Tools Data Visualization & Communication Automated Reporting Applications Building Development & Test Environments Data Repository Creation Programming Experience Using Python, Java or Scala Project Planning - Big Data - Resourcing, Development, Integration ETL Layers & Performance Tuning Background of Business: 1/ST Technology is a fully integrated racing and gaming technology company providing solutions that drive pari-mutuel and fixed odds wagering around the globe. Leading technology and services provider to the North American pari-mutuel wagering market, with services that include the horse racing industry s most comprehensive and user-friendly wagering website/platform allowing customers to wager from a computer, phone or mobile device. Ongoing commitment to the growth and success of the global racing industry through B2C and B2B product innovation, extensive professional services offerings, the broadest integration of hosts for commingled pari-mutuel and fixed odds and the continued evolution of the preeminent totalizator systems in the world.
RESPONSIBILITIES/DUTIES Collaborates and participates in the design and implementation of a robust and scalable Data Warehouse ensuring all systems meet the business/company requirements as well as industry practices Documents technology specifications and ensures any new technology solutions are optimal for meeting needs; leverages existing technologies when possible Translates business requirements into data models that are easy to understand and used by different disciplines across the company Works collaboratively with analysis and development teams to create standards and best practices for BI (Business Intelligence) and data science solutions Partners with domain business experts, data analysts and engineering teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enables self-service Works to constantly improve data reliability and quality and supports ongoing incorporation of new data sources Develops quality framework to ensure delivery of high quality data and analyses to stakeholders Identifies, documents and promotes best practices Troubleshoots and solves production Data Warehouse issues Participates in research and development efforts (proof of concept, prototype) as a subject matter expert when introducing new technologies Lead and mentor other developers Performs other duties as assigned Leads, manages and supports one-two (1-2) Data Engineer positions within the group throughout the entire employment lifecycle including (but not limited to) responsibility for recruitment (attracting best/top talent), performance management, training and retention of team members Builds, develops, guides and manages team members capable of carrying out needed strategies and tasks including setting and managing team/individual KPIs Demonstrates excellent change agent skills utilizing a management style that mentors/coaches team members and colleagues to inspire their best performance which encourages consistency, fairness and transparency Aligns and integrates department goals with other departments fostering partnerships that drive individual and business growth
EXPERIENCE & EDUCATION Bachelor s degree in Computer Science, Software Engineering, Data Science or related field 5 years of experience in a technical role supporting BI and data science efforts. This should include application of knowledge in statistics, data wrangling, data visualization and communication 5 years of experience in database development and tools. Ideally this includes: ETL, data modeling, complex queries, performance tuning and stored procedures/functions 5 years of programming experience using one or more of Python, Java or Scala 3 years working with Amazon Cloud technologies like Redshift or Snowflake, Athena, Glue, RDS, EC2, and S3 or similar experience with other cloud platforms like Azure or Google Cloud. Comfortable contributing to a nascent data ecosystem, and building a strong data foundation for the company Proven track record of successfully delivering large data-centric projects Strong skills in design and implementation of logical and physical approaches to managing and analyzing large volumes of data with knowledge of best practices Strong relationship management skills; able to interface effectively with all organizational levels: users, team members, and management Ability to produce high quality documentation of business and system requirements, system design, data architecture and training materials Experience with data visualization tools such as Periscope is a plus. Experience managing multiple projects simultaneously with a team spanning multiple geographical locations and outsourcing Effective, consistent and impeccable communication, interpersonal, leadership, organizational, people management, presentation, project management, teamwork and training skills Self-starter, self-motivator, detail-oriented, highly organized Demonstrates and maintains flexibility and adapts to changes within industry and company Preferred Experience and/or Education: Master s degree in Computer Science, Engineering or related field; Wagering/gaming industry experience;