Senior Data Engineer

  • Odesus,
  • Rancho Park, CA
  • 1 month ago
Amazon S3, Apache Flink, Apache Hadoop, Apache Kafka, Apache Spark, Data architecture, Data engineering, Data processing, Data retention, Data warehouse, ETL, Elasticsearch, Information security, MySQL, Python, Scrum, PostgreSQL, Security, Software engineering, Warehouse
Contract W2, 9 Months
Depends on Experience
Work from home available

Job Description

As a Senior Data Engineer on the Security Operations team within the Information Security group, you bring a unique mix of distributed data processing, data warehousing, and software engineering skills to develop scalable data systems that inform our decisions and ensure the safety of platforms and the players using them. You can translate security requirements into sustainable data architecture and workflows. You will work with Security and Software Engineers to solve current problems and create new opportunities. You will design and promote our technical strategy for how we use data to transform security operations. You will work with engineers across Information Security group to establish and promote standards for collecting, processing, storing, and analyzing data.

Responsibilities:
Create and promote a technical design and architectural vision for security operations data systems and tooling
Work with engineers on the team to manage infrastructure for moving and processing large-scale data Improve log flows efficiency through data processing to reduce the cost of analysis and storage
Convert log flows from Logstash to Elastic
Common Schema Work with Analysts to determine and implement the best practices for data retention and storage
Design and promote standards for security operations data telemetry and processing
Help engineers across the team select data technologies for their development needs
Be the face of data best-practices to engineers on the team around the product by advocating for data considerations early in the product life cycle and educating teammates on how to get the most out of the data ecosystem.

Required Qualifications:
2+ years experience working with data systems years experience with data
2+ warehousing, processing, pipelines, infrastructure, and query
2+ patterns years experience with Spark or Hadoop years experience with
2+ open source ETL frameworks such as Airflow, Luigi, or similar
4+ years experience with Python and SQL
Bachelor’s degree in Computer Science or related field

Desired Qualifications:
Experience with systems for data processing (Spark, Flink, Hadoop, Airflow) and storage (S3, Kafka, ElasticSearch, Dynamo, MySQL, or Postgres)
Experience with ELK Experience reading and optimizing data schema queries for content and performance
Experience working in agile project management methodologies (Scrum, Kanban) For this role, you'll find success through craft expertise, a collaborative spirit, and decision-making that prioritizes the delight of players. We will be looking at your past studies, experience, and your personal relationship with games. If you embody player empathy and care about the experiences of players, this could be the role for you!

Dice Id : 10106335
Position Id : 6668471
Originally Posted : 8 months ago
Have a Job? Post it

Similar Positions

Senior Data Engineer
  • IT Avalon
  • Santa Monica, CA, USA
Senior Software Engineer
  • Odesus
  • Los Angeles, CA, USA
Sr. Data Engineer with PowerBI and Tableau
  • Byteware Inc.
  • El Segundo, CA, USA
Senior Data Engineer
  • Motion Recruitment
  • Los Angeles, CA, USA
Senior Java Engineer w/heavy Data
  • Motion Recruitment
  • Los Angeles, CA, USA
Senior Data Engineer / Local to Los Angeles / $150,000 a year
  • Motion Recruitment
  • Los Angeles, CA, USA
Senior Data Engineer at Medical AI Company
  • Motion Recruitment
  • Los Angeles, CA, USA
Mid to Senior Data Engineer at LA based FinTech Company
  • Motion Recruitment
  • Los Angeles, CA, USA
Senior Java Engineer / Data Focus
  • Motion Recruitment
  • Los Angeles, CA, USA