Hadoop Developer
Vaarida Technologies llc
Dice Job Match Score™
✨ Finding the perfect fit...
Job Details
Skills
- SQL
- Unix
- Artificial Intelligence
- Productivity
- Analytical Skill
- Data Processing
- Data Engineering
- Big Data
- Apache Hadoop
- Extract
- Transform
- Load
- ELT
- Java
- Python
- Apache Spark
- Management
- Apache Hive
- Data Quality
- Data Validation
- Microsoft
- Documentation
- Testing
- Real-time
- Streaming
- Apache Kafka
- Collaboration
- DevOps
- Root Cause Analysis
- Unstructured Data
- Agile
- Sprint
- Estimating
- SANS
- Mentorship
- IT Management
Summary
Position - Hadoop developer
Location - Charlotte, NC
Experience - 10 Years
Type - Full Time
Job Description -
Primary Skill: Spark, Java, Hive, SQL
Secondary: Unix, Kafka, Python
Roles & Responsibilities
We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including Java, Spark, Hadoop Ecosystem and Hive. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions. Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree.
The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.
Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
Build and optimize ETL/ELT pipelines using Java, Spark, Hive, and Python.
Process and analyze large datasets in distributed environments.
Develop high-performance Spark jobs and optimize existing workloads.
Create and manage Hive tables, partitions, views, and complex queries.
Implement data quality, data validation, and reconciliation frameworks.
Perform code reviews and ensure adherence to coding standards and best practices.
Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities.
Strong experience building both batch and real-time streaming applications with Kafka.
Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams.
Troubleshoot production issues and perform root cause analysis.
Design data ingestion frameworks for structured, semi-structured, and unstructured data.
Participate in Agile ceremonies including sprint planning, estimation, and retrospectives.
Mentor junior developers and provide technical leadership.
- Dice Id: 91159272
- Position Id: OOJ - 1458-462-1785362595
- Posted 1 hour ago
Company Info
Vaarida (Sanskrit name for the Cloud) Tech is IT Infrastructure Services provider and a trusted partner to enterprises in their IT-as-a-Service journey. VaaridaTech enables global enterprises to become more agile and innovative through a comprehensive portfolio of services that addresses hybrid IT transformation, workspace transformation, service transformation and end-to-end IT Infrastructure Management. VaaridaTech has been Infrastructure Management Provider by Global Services, IBM and Microsoft Business Partner. VaaridaTech's management team, with deep domain knowledge and industry leading expertise, ensures personalized client management. VaaridaTech has strategic partnerships with IBM, AWS, Microsoft and VMware in the emerging technology areas and works very closely with these technology alliances to deliver services around their technologies in the Hybrid IT and Workspace Transformation space. We help businesses compete and win in today's technology-driven global markets through Staffing, Solutions and Products. VaaridaTech Consulting & Staffing provides rewarding career opportunities for Consultants and enables our Clients to become more agile and competitive through the innovative use of technology, people and process. Our Staffing division places top technology professionals in contract, contract-to-hire, direct hire and SOW / Statement of Work based positions with industry leaders and innovative start-ups that are developing the next generation of technology solutions. VaaridaTech's flexible cost-effective delivery models feature dedicated account teams, skill-based recruiters and proven systems and processes. So whether you’re an experienced technology professional who is ready for a new career opportunity, or a business in need of technology consultants, permanent staff or enterprise solutions, VaaridaTech will help you meet your individual or business objectives.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs