Data Engineer with Spark, Airflow, and Kafka

Engineer, Python, Engineering, IT
Full Time

Job Description

We are working with a data analytics company in the media and entertainment space that is hiring a Data Engineer. They provide insights and tools to make data more accessible for professionals in the industry and they are looking to build out their team as the are growing quickly.

They are targeting a Data Engineer with a background in Python and/or Scala and experience building out ETL pipelines. Ideally the Data Engineer will have experience with big data tools such as Spark and Airflow as well as cloud-hosted infrastructure with AWS or Google Cloud Platform. Any experience with messaging services like Kafka and RabbitMQ is a plus as well.

Required Skills & Experience
  • 3+ years' experience with Data Engineering in Python or Scala
  • Experience in a cloud-based environment, ideally AWS
  • Experience with building ETL pipelines
  • Experience with Spark or Airflow
  • Excellent communication

Desired Skills & Experience
  • Exposure to Kafka or RabbitMQ
  • Experience with Redshift or Snowflake
  • Motivated self-starter

What You Will Be Doing

Tech Breakdown
  • 100% Data Engineering

Daily Responsibilities
  • 85% Hands-on Coding
  • 15% Coordinating with other teams

The Offer
  • Competitive Salary: Up to $150K/year, DOE

You will receive the following benefits:
  • Full Medical and Dental Insurance
  • 401k
  • Paid time off
  • Paid sick leave
  • Commuter benefits

Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.

Motion Recruitment provides IT Staffing Solutions (Contract, Contract-to-Hire, and Direct Hire) in major North American markets. Our unique expertise in today's highest demand tech skill sets, paired with our deep networks and knowledge of our local technology markets, results in an exemplary track record with candidates and clients.

We are working with a data analytics company in the media and entertainment space that is hiring a Data Engineer. They provide insights and tools to make data more accessible for professionals in the industry and they are looking to build out their team as the are growing quickly.

They are targeting a Data Engineer with a background in Python and/or Scala and experience building out ETL pipelines. Ideally the Data Engineer will have experience with big data tools such as Spark and Airflow as well as cloud-hosted infrastructure with AWS or Google Cloud Platform. Any experience with messaging services like Kafka and RabbitMQ is a plus as well.

Required Skills & Experience
  • 3+ years' experience with Data Engineering in Python or Scala
  • Experience in a cloud-based environment, ideally AWS
  • Experience with building ETL pipelines
  • Experience with Spark or Airflow
  • Excellent communication

Desired Skills & Experience
  • Exposure to Kafka or RabbitMQ
  • Experience with Redshift or Snowflake
  • Motivated self-starter

What You Will Be Doing

Tech Breakdown
  • 100% Data Engineering

Daily Responsibilities
  • 85% Hands-on Coding
  • 15% Coordinating with other teams


The Offer
  • Competitive Salary: Up to $150K/year, DOE

You will receive the following benefits:
  • Full Medical and Dental Insurance
  • 401k
  • Paid time off
  • Paid sick leave
  • Commuter benefits

Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.

Motion Recruitment provides IT Staffing Solutions (Contract, Contract-to-Hire, and Direct Hire) in major North American markets. Our unique expertise in today's highest demand tech skill sets, paired with our deep networks and knowledge of our local technology markets, results in an exemplary track record with candidates and clients.
Dice Id : 10105282
Position Id : 488710
Originally Posted : 6 months ago
Have a Job? Post it

Similar Positions

Data Engineer
  • Motion Recruitment
  • New York, NY, USA
Data Engineer
  • Motion Recruitment
  • New York, NY, USA
Senior Data Engineer
  • Audible
  • Newark, NJ, USA
Senior Data Engineer
  • Audible
  • Newark, NJ, USA
Big Data Spark Developer
  • The Tri-Com Consulting Group
  • New York, NY, USA
Data Engineer
  • Motion Recruitment
  • New York, NY, USA