Senior Big Data Engineer / Spark Lead (Remote)

spark, pyspark, sql, scala, Apache Spark
Full Time
Depends on Experience
Work from home not available Travel required to 25%.

Job Description

 

Dynamic, Entrepreneurial Marketing Consulting Company is seeking an Apache Spark Developer Lead to contribute to BLEND360 next level of growth and expansion.

BLEND360 is a multi-award winning Data-Driven Marketing Company who is privileged to provide our services to some of the most respected and recognized brands in the world. We aspire to have the best people, period! We have created a special culture where the brightest people come to work with the best clients, hone their craft, learn new skills and methodologies, and also have the flexibility to live their best lives in every way possible... and most of all, be part of the ever-growing, diverse family that is BLEND360.

The Apache Spark Director will be a self-starting, motivated individual with is a strong developer who knows how to fully exploit the potential of our client s Spark cluster.

The Details:

  • Location: Columbia, MD preferred, but will consider East Coast with travel to clients
  • Duration: Fulltime Position
  • Benefits: We offer: Health, Vision, Dental, 401K plan, Life Insurance, and an incredibly supportive team cheering you on!

What you ll do:

In this role, you ll partner with our Fortune 100 clients and work within our Data Science team as our Apache Spark SME . You will clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our Data Scientists.

This involves both ad-hoc requests as well as data pipelines that are embedded in our production environment..

Additionally, you ll:

  • Bring a strong background in Spark, PySpark, and Hadoop to the job
  • Create Scala/Spark jobs for data transformation and aggregation
  • Produce unit tests for Spark transformations and helper methods
  • Write Scaladoc-style documentation with all code
  • Design data processing pipelines

What you ll get:

  • A fast-paced environment with supportive cross-functional partners
  • A team dedicated to transparency and simplicity to its customers
  • To be part of product, acquisition and servicing teams
  • Valuable experience running data science technologies for a highly visible Fortune 100 company
  • Support and expertise from all levels of the BLEND360 team including the Client Engagement and Talent teams
  • Benefits including Health, Vision, Dental, 401K plan, Life Insurance, Pretax Commuter Benefits, and an incredibly supportive team cheering you on!

Who you are:

You are a highly skilled expert in the Apache Spark cluster .

What you have:

  • Expert in full Spark Cluster, (2.x) PySpark and Hadoop
  • Experience with Scala, Scalatest, Junit, Mockito, Embedded Cassandra
  • Spark query tuning and performance optimization
  • Experience with SQL and relational databases
  • Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
  • Proven ability to prioritize work and projects
  • Accustom to working on multiple projects simultaneously
  • Self-starter and strong interpersonal skills
  • Proficient with Microsoft office suite (Excel, Word, PowerPoint)

Other:

  • Desire to work for a consulting firm with ability to travel up to 25%
  • Ability to keep a sense of humor while working in a fast pace environment
  • Collaborate well cross functionally and are an enthusiastic team player

Posted By

Roni Zapin

Dice Id : RTX15a507
Position Id : 6252367
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

Big Data Developer
  • GEICO
  • Chevy Chase, MD
Big Data Engineer
  • Conrelv Solutions Inc
  • Rockville, MD
Big Data Developer
  • Quantum Vision LLC
  • Maryland City, MD
Big Data Technologist
  • Federal Bureau of Investigation (FBI)
  • Washington D.c., DC
BigData Developer
  • SSN Group LLC
  • Rockville, MD
Big Data Engineer
  • Fusion IT Inc
  • Mclean, VA
AWS developer with Big Data Stack exp
  • Merritt Technical Associates
  • Owings Mills, MD
Big Data Developer
  • Eliassen Group
  • Rockville, MD
Big Data Enginner
  • DISYS - Digital Intelligence Systems, LLC
  • Owings Mills, MD
Big Data Developer
  • Saksoft
  • Rockville, MD
Big Data/PySpark Engineer
  • Vaco Technology
  • Mclean, VA
BigData Developer - Senior
  • CompuGain Corporation
  • Mclean, VA
Big Data Engineer
  • Relevance Lab Inc.
  • Mclean, VA
Big Data Engineer
  • ANR Consulting Group, Inc.
  • Mc Lean, VA