Senior Data Engineer

databricks, cloudera hadoop
Full Time
Depends on Experience
Work from home available Travel not required

Job Description

Senior Data Engineer

Senior Data Engineer
One of our clients, a Global Market Research Company, is looking for talented Senior and Lead Data Engineers
Permanent position with excellent compensation package and benefits.
This position can also be a contract to hire opportunity.

Location: 100% Remote position (HYBRID after Covid restrictions are lifted (NY, TX, VA, NC, IL)
No H1 Visa Support For This Role


Please read the description below and to be considered immediately email your resume to

BarryR@ brainsworkgroup.com
 
Senior Data Engineer

Responsibilities

  • Senior data engineering with hands on experience working with cloud and Big data platforms.
  • A BIG PLUS for a lead level: Manage and mentor a team of 3-5 data engineers
  • Responsible for data engineering, data analysis and user support primarily focused on Azure Databricks and Cloudera Hadoop. 
  • Strong hands-on technical skills and mentor and train other Engineers with programming languages such as Python and Scala, including tuning complex big data spark applications.
  • Design, develop, and maintain highly scalable cloud-based data processing applications
  • Write efficient, reusable and well documented code
  • Deliver highly complex big data projects using Databricks, Data Factory and other Azure services
  • Maintain and tune existing Hadoop/Hbase applications and migrate to Azure cloud

Qualifications:

  • 5+ years of software development and design
  • A BIG PLUS: 2+ years of leading a team of 3-5 software developers
  • Experience in developing and tuning SPARK applications using Databricks
  • Excellent understanding of spark architecture, spark SQL, data frames and tuning big data spark applications
  • Excellent with Python, Scala, SQL and shell scripting
  • Hands-on experience with cloud platforms like Azure or AWS
  • Experience in Database Design and Data Modeling
  • Excellent problem solving and analytical skills
  • Strong diagramming skills – flowcharts and data flows
  • Solid written and verbal communication skills
  • Experience with Synapse, Snowflake or Google BigQuery is a plus

Bachelor's degree in Computer Science or related field

Use this link to apply directly:
https://brainsworkgroup.catsone.com/careers/index.php?m=portal&a=details&jobOrderID=14133780
Or email: barryr@brainsworkgroup. com
Check ALL our Jobs: http://brainsworkgroup.catsone.com/careers

Dice Id : RTL499109
Position Id : BIGDATA-9-21
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

Scala Hadoop Developer
  • Aletheia Technologies Corporation
  • Hanover, NJ, USA
Senior Data Engineer
  • Motion Recruitment
  • New York, NY, USA
Senior Data Engineer- Python/ Scala/ AWS
  • Motion Recruitment
  • New York, NY, USA
Sr Data Engineer
  • Judge Group, Inc.
  • New York, NY, USA
Java Engineer - Data Streaming
  • Jobot
  • New York, NY, USA
Lead Data Engineer
  • Capital One
  • New York, NY, USA
Big Data Developer
  • Vox Financial Partners
  • New York, NY, USA
Master Data Engineer
  • Capital One
  • New York, NY, USA