Hadoop developer

Charlotte, NC, US • Posted 7 hours ago • Updated 7 hours ago
Full Time
No Travel Required
On-site
95000 - 115000/yr
Company Branding Image
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • Agile
  • Apache Kafka
  • Artificial Intelligence
  • Apache Spark
  • Big Data
  • Collaboration
  • Data Validation
  • Documentation
  • DevOps
  • Data Engineering
  • Data Quality
  • ELT
  • Apache Hadoop
  • PySpark
  • Productivity
  • Sprint
  • Root Cause Analysis
  • Testing
  • Unix
  • Unstructured Data
  • Real-time
  • Streaming
  • Mentorship
  • Python
  • Legal
  • Insurance
  • Finance
  • Extract, Transform, Load
  • Apache Hive
  • Estimating
  • Microsoft
  • IT Management

Summary

Hadoop developer
Charlotte, NC | 10 - 15 years of experience
Job Description
Must Have Technical/Functional Skills
 
Primary Skill: PySpark, Hive, Python, SQL
Secondary: Unix, Kafka, Java
Experience: 10+ years
 
Roles & Responsibilities
 
We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including PySpark, Hadoop Ecosystem, Hive, and Python. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions.
Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor''s or master''s degree.
The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.
 
· Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
· Build and optimize ETL/ELT pipelines using PySpark, Hive, and Python.
· Process and analyze large datasets in distributed environments.
· Develop high-performance Spark jobs and optimize existing workloads.
· Create and manage Hive tables, partitions, views, and complex queries.
· Implement data quality, data validation, and reconciliation frameworks.
· Perform code reviews and ensure adherence to coding standards and best practices. 
· Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities. 
· Strong experience building both batch and real-time streaming applications with Kafka. 
· Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams. 
· Troubleshoot production issues and perform root cause analysis. 
· Design data ingestion frameworks for structured, semi-structured, and unstructured data. 
· Participate in Agile ceremonies including sprint planning, estimation, and retrospectives. 
· Mentor junior developers and provide technical leadership.
 
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
 
Salary Range: $95,000 - 115,000 a year
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172467
  • Position Id: 9045381
  • Posted 7 hours ago

Company Info

About TATA Consultancy Services Limited

Tata Consultancy Services (TCS) is the technology partner of choice for industry leading organizations worldwide. Since its inception in 1968, TCS has upheld the highest standards of innovation, engineering excellence, and customer service.

It has set an aspiration to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence. Rooted in the heritage of the Tata Group, TCS is focused on creating long term value for its clients, its investors, its employees, and the community at large.

With a highly skilled workforce spread across 55 countries and 202 service delivery centers across the world, the company has been recognized as a top employer in six continents. With the ability to rapidly apply and scale new technologies, the company has built long term partnerships with its clients – helping them emerge as perpetually adaptive enterprises.

Many of these relationships have endured into decades and navigated every technology cycle, from mainframes in the 1970s to artificial intelligence today.

TCS sponsors 14 of the world’s most prestigious marathons and endurance events, including the TCS New York City Marathon, TCS London Marathon and TCS Sydney Marathon with a focus on promoting health, sustainability, and community empowerment.

About_Company_OneAbout_Company_Two
Contact the job poster
PJ

Preetirekha Jena

Recruiter @ TATA Consultancy Services Limited
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

22d ago

Easy Apply

Full-time

100,000 - 130,000

Charlotte, North Carolina

22d ago

Easy Apply

Full-time

100,000 - 130,000

Search all similar jobs