Search Jobs | Dice.com

Job Details

Skills

PySpark
ETL
Sql
Data Engineer

Summary

Responsibilities: Development and Maintain Data Pipelines: Design, implement, and optimize end-to-end ETL/ELT pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data. Utilize Python and Pyspark: Write efficient, scalable and maintainable code in Python and leverage Pyspark for large-scale data processing in distributed computing environments. Also be able to review existing code and identify areas of improvement. Ensure Data Quality and Integrity: Implement data validation, cleansing, transformation and reconciliation processes to ensure data accuracy and consistency throughout the data lifecycle. Collaborate with Stakeholders: Work closely with IT teams and business stakeholders to gather data requirements and translate them to technical solutions. Troubleshoot and Optimize: Monitor job performance, troubleshoot complex data issues and fine-tune for performance and scalability. Adhere to Best Practices: Participate in code reviews, establish coding standards, and implement CI/CD pipelines for automated testing and deployment. Skills: Strong hands-on coding proficiency in Python, Pyspark and SQL (Microsoft SQL Server preferred) Experience with big data frameworks (Hadoop, Spark). Experience with cloud platforms ( AWS, Azure or Google Cloud Platform) Experience with Code versioning tools ( Bitbucket, Github ) Experience with CI/CD and setting up pipelines. Solid understanding of database design principles, data modelling, schemas and data warehousing solutions. Excellent problem-solving and analytical skills to troubleshoot complex data issues independently.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: hexaware
Position Id: 9020160
Posted 26 days ago

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Contact the job poster

Manish Kumar

Recruiter @ Hexaware Technologies, Inc

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Irving, Texas

•

Today

Hi, We are currently looking for a PySpark Developer for a full-time opportunity in Irving, TX with one of our global clients. If you are interested, please reply with your updated resume and let me know a convenient time to discuss the opportunity. Job Title: PySpark Developer Experience: 8- 10 Years Location: Irving, TX- Hybrid Duration: Fulltime Role Overview: Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines and data transformation

Easy Apply

Full-time

Data Engineer with Pyspark Experience

Dallas, Texas

•

Today

Data Engineer PySpark Experiencer Location: Dallas TX Job Summary We are seeking an experienced Data Engineer with strong expertise in PySpark, ETL integration, and large-scale data migration projects. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, integrating data from multiple enterprise systems, and executing complex data migration initiatives while ensuring data quality, governance, and performance. Required Experience 10 years of

Easy Apply

Contract

Depends on Experience

Data engineer (In person interview is required)

Dallas, Texas

•

6d ago

Job Description:We are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing, building, and optimizing our next-generation scalable data pipelines. This position requires expertise in processing massive datasets using cutting-edge technologies like Apache Spark, PySpark, and Hive within a dynamic cloud environment. Your primary objective will be to ensure the utmost data reliability, speed, and efficiency, providing a robust foundation for downstream business i

Easy Apply

Full-time

120,000 - 140000

Senior Data Engineer ID75059

Dallas, Texas

•

Today

Job Description AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to d

Full-time

More jobs at Hexaware Technologies, Inc in Irving, TX

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

PySpark lead developer

Skills

Summary

Dice Job Match Score™

Manish Kumar

Similar Jobs

PySpark lead developer

Job Details

Skills

Summary

Dice Job Match Score™

Manish Kumar

Similar Jobs