Big Data Lead

Hadoop, Big Data, APIs, Financial Services, Analytic, Spark Streaming, Cloud environment
Full Time, Contract Independent, Contract W2, C2H W2, fulltime

Job Description


Good Morning,

Hope you are doing well.

My name is Ruchi Singh from United Software Group Inc.

I am aggressively recruiting for one of the position for Big Data Lead|| Pittsburg, PA, United States with one of our client. Please have a look at the job description below and if interested feel free to call me or revert to this email (

Big Data Lead

Location: Pittsburg, PA


Job Description is given below:

Big Data Lead Pittsburg, PA

Looking for Big Data Lead with a track record in building high performing Big Data and analytical solutions for minimum of 5 years.

He/she will be responsible for work with experienced Big Data engineers Team for building data solutions including architecture, design, build, test, and support as a core member in Agile environment.

The role is client facing and be able to propose best solutions, demonstrate the work done by team through daily, weekly and sprint wise reports.

Primary responsibilities include:

Build Big data pipelines working with product owners, data architects, data analysts, testers in agile environment.

Analyze data to identify gaps in requirements for data ingestion and provide robust optimal data ingestion solutions to meet the requirements.

Building comprehensive data pipeline solutions to meet the requirements adhering to quality and development standards.

Articulating the data pipeline solutions to management & team members, documenting as required.

Collaborating with cross functional team members as necessary and deliver quality code in time.

Executing unit test of data validating expected result and ensure quality & accuracy.

Coordinating with business users and BI developers for User Acceptance Testing.

Work with Operations team for code deployment to production.

Experience in change management procedures and strictly adhere to the compliance and regulatory needs

Work with team and ensure completion in stipulated timelines.

Help and guide onsite and offshore team as and when required.

Required Skills/Experience:

Hands on experience in building batch and streaming data solutions in Cloudera big data platforms in agile environment.

Experience with Hadoop ecosystem (Cloudera Hadoop, Hive, Sqoop, Hue, HQL, Oozie, PySpark).

Familiarity with RDBMS such as Teradata, Oracle, MS-SQL Shell scripting & Python.

Must be a team player and collaborate in a cross functional team environment.

Self-starter and ability to work independently with minimal guidance.

Performance tuning and optimization of code.

Experience in working with large teams and client facing roles.

Preferred Skills / Experience:

Experience in the financial services industry.

Spark streaming, APIs.

Cloud environment experience.

Familiarity with Business Intelligence/Reporting tools such as Tableau.

Experience with handling structured, semi-structured and unstructured data in Hadoop environment.

Familiarity with scheduling tools such as CA7Sensitivity: Internal & Restricted.

Version controlling using GIT /Bit bucket.

Familiarity building CICD pipeline.

Familiarity with Data tokenization methods.

Familiarity with Salesforce, MDM.

With Regards,

Ruchi Singh | Account Manager

United Software Group, Inc.

End-to-End IT Systems | Services | Solutions Provider

A Minority Business Enterprise

6000 Venture Dr,

Suite C & D,

Dublin, OH 43017

Phone: 614-495-9222 Ext.663

Fax: 866-764-1148


2016 - 2017 - 2018


Dice Id : 10204540
Position Id : 2021-37292
Originally Posted : 3 months ago
Have a Job? Post it

Similar Positions

Big Data Architect Lead
  • United Software Group
  • Pittsburgh, PA, USA
Jr. Associate Hadoop Big Data Architect W2
  • Computer Enterprises, Inc.
  • Pittsburgh, PA, USA
Jr. Associate Hadoop Big Data Architect - W2
  • Computer Enterprises, Inc.
  • Cleveland, OH, USA
Senior Java/Big Data Developer
  • DISYS - Digital Intelligence Systems, LLC
  • Reston, VA, USA
MCD - Technical Specialist 3 / TS3
  • Neumeric Technologies Corporation
  • Columbus, OH, USA
Java/Big Data/Hadoop Developer
  • ALTA IT Services
  • Reston, VA, USA
Big data developer / Data Engineer
  • Reveille Technologies
  • Columbus, OH, USA
Hadoop Developer - 9+ years of experience
  • Next Level Business Services, Inc.
  • McLean, VA, USA
Big Data Engineer - NO VISA
  • Volitiion IIT Inc
  • Vienna, VA, USA
Big Data ETL Developer (Hadoop)
  • Sparksoft
  • Columbia, MD, USA