Senior Data Engineer

  • Odesus,
  • Rancho Park, CA
  • 1 week ago
Amazon Web Services, ETL, EMR, Data engineering, Data mining, Data warehouse, Database, Informatica, SQL, Apache Hive, Apache Hadoop, Amazon Redshift, Apache Kafka, Apache Spark, Amazon Kinesis
Full Time
Depends on Experience
Work from home available

Job Description

JOB DESCRIPTION

Senior Data Engineer will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only deliver data but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.

A SNAPSHOT OF YOUR RESPONSIBILITIES

  • Drive and participate in the definition, the direction, and the development of the DCI data warehousing platform
  • Collaborate with internal stakeholders to help dictate and scope the requirements
  • Design and implement highly scalable, reliable, extensive, and maintainable code frameworks
  • Establish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworks
  • Work with the infrastructure team to ensure that all the required monitoring, exception handling, and fault tolerance is in place for production-quality data platforms
  • Team up with analysts, product managers, and other stakeholders to understand evolving business needs and translate reporting capabilities accordingly
  • Identify and investigate emerging trends within our market and the industry as a whole
  • Assist with process improvement with a customer-focused, progressive mindset
  • Analyze large amounts of data, uncover and solve business challenges

WHAT YOU WILL NEED

  • 5+ years as a professional engineer with experience in production scale platforms
  • Strong experience in data mining and the development of ETL processes using SQL or tools like Informatica, Matillion, Talend, etc.
  • Strong experience with distributed data architectures and their eco-systems (Spark, EMR, Hadoop, Hive)
  • Strong experience in delivering data using Streaming Technologies (Kafka, Kinesis, Spark Streaming, etc.)
  • Experience with continuous integration technologies
  • Strong understanding of data warehousing concepts
  • Expert understanding of the agile software development life cycle
  • Expert knowledge of Amazon Web Services (AWS) and Redshift in an enterprise environment
  • Excellent knowledge and expertise with SQL, T-SQL, Postgress and Relational & Multi-dimensional Databases
  • Discerning appreciation of best practices in designing data lakes/lake houses
  • Proven ability to deliver high quality, production-ready code
  • Strong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineering
  • Strong industry experience with several development languages (Python, Java, Scala, NodeJs)

NICE TO HAVE, BUT NOT A DEAL BREAKER

  • Bachelor’s degree in computer science
  • Experience with SFMC
  • Experience with Delta Lake technologies
Dice Id : 10106335
Position Id : 6811914
Originally Posted : 2 months ago
Have a Job? Post it