Overview
Skills
Job Details
Position Title : Data Engineer Hadoop Big Data Stack
Location : Cary, NC (Hybrid)
Experience : 6+ Years (Mandatory)
Employee Type : Full Time with Benefits
Job Description:
We are seeking a highly skilled and motivated Data Engineer with strong hands-on experience in the Hadoop Big Data ecosystem. The ideal candidate will have deep expertise in big data technologies and frameworks, and a passion for building scalable data solutions that drive business insights.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Hadoop and related technologies.
- Work with large-scale datasets using tools such as Spark, Scala, Hive, Pig, and HBase.
- Implement and optimize data workflows and ETL processes.
- Collaborate with data scientists, analysts, and other engineering teams to support data needs.
- Ensure data quality, integrity, and governance across platforms.
- Troubleshoot and resolve issues related to data processing and performance.
Required Skills & Qualifications:
- Strong hands-on experience as a Hadoop Developer or Big Data Engineer.
- Advanced knowledge of the Hadoop ecosystem and its components.
- In-depth expertise in Scala, Spark, and similar frameworks.
- Proficient in HBase, SOLR, Hive, Gremlin, and Pig.
- Experience with data modeling, performance tuning, and distributed computing.
Nice to Have:
- Experience with Spark Streaming, Flume, or Apache NiFi.
- Exposure to Azure Data Engineering stack, including:
- Azure Synapse Analytics
- Azure Data Factory (ADF)
- Azure Databricks
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Click the following link for more information on your rights as an Applicant ;/p>