Big Data Engineer
Contract Corp To Corp
Contract W2
Contract Independent
No Travel Required
Able to Sponsor
On-site
Depends on Experience
Chabez Tech LLC
Fitment
Dice Job Match Score™
📊 Calculating match score...
Job Details
Skills
- Data Engineering
- or related field. Experience in Financial Services or regulated industries. Exposure to petabyte-scale data processing environments. Experience with Kubernetes
- EKS
- or serverless architectures. Experience with data lake and modern data platform architectures. AWS certifications. Experience with AI-assisted development tools such as GitHub Copilot
- ChatGPT
- Claude
- or similar. Experience in prompt engineering
- AI workflow design
- and AI-driven productivity. Strong understanding of data governance
- compliance
- and security best practices. Experience driving organizational adoption of modern data and AI engineering practices.
Summary
- Need Locals to MD VA DC
Design, develop, and maintain large-scale data pipelines using modern big data technologies such as Spark, Hadoop, Hive, and Trino. - Build scalable and reliable solutions for data ingestion, transformation, storage, and analytics.
- Architect distributed data platforms capable of processing massive (petabyte-scale) datasets.
- Optimize and enhance existing data pipelines for performance, scalability, cost efficiency, and reliability.
- Implement automated testing frameworks and continuous validation for data quality and pipeline accuracy.
- Develop unit, integration, and end-to-end test strategies for data platforms.
- Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
- Support data scientists and analytics teams by delivering high-quality, production-ready datasets.
- Monitor, troubleshoot, and resolve data pipeline issues in production environments.
- Investigate and resolve challenges such as data skew, resource constraints, job failures, and large-scale system bottlenecks.
- Apply Spark tuning techniques including partitioning, caching, broadcast joins, and performance optimization.
- Ensure strong software engineering practices, including version control, code quality, and CI/CD automation.
- Stay current with emerging big data, cloud, and AI technologies to continuously improve data architecture.
- Drive AI-enabled development practices, including prompt engineering, AI-assisted coding, and workflow optimization.
- Partner with stakeholders to ensure regulatory, governance, and financial data integrity requirements are met.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 90942163
- Position Id: 03412
- Posted 6 days ago
Company Info
About Chabez Tech LLC
Chabez Tech is a fast growing IT services and software development firm providing services across several domains. Chabez Tech is headquartered in Pennsylvania with a client base all around the world. Chabez Tech provides a wide variety of IT services, Application development and IT solutions. We have an offshore hub for back end operations and support for clients all over the world.
We strongly believe in providing value to our customers by providing accurate and state of the art solutions. We are continuously keeping ourselves on cutting edge of the technology to provide best IT solutions. Business needs are changing rapidly in order to cope up with the ever changing technology we are always trying to reinvent ourselves. We are committed to address your needs with solutions that are highly reliable and scalable.
Chabez Tech always looks to develop out of the box solutions to run the business operations in much more efficient way. We strive to excel and focus on customer engagements so that we always exceed the expectations of our clients. Also provides innovative solutions so that our clients are leading the way and have a competitive advantage over others. We measure our success with the success of our clients.
Chabez Tech has a dedicated team which is expertise, has rich experience and strong knowledge amongst most of the domains. This perfect blend strives to work towards customer satisfaction and relationship with the clients. Our team works round the clock and available at your service 24/7. We have a passionate team which is always striving for customer satisfaction.
Chabez Tech is committed to provide high quality software and IT solutions for your needs. We have a created a place for us in this industry with a basket of existing Domestic and International projects. We are expertise in ERP, Application development, IT Training, DBA services, BPO services and other IT solutions.
Our solutions are unique and customized solutions. Every business has different needs to be fulfilled hence our solutions can be fully customized. Chabez Tech adopts a strategy which is best suited for any specific needs. We provide best solutions for helping you to grow your business. We ensure that we have strong relationship based on trust and integrity which helps us in a long lasting relationship with our clients.
We strongly believe in providing value to our customers by providing accurate and state of the art solutions. We are continuously keeping ourselves on cutting edge of the technology to provide best IT solutions. Business needs are changing rapidly in order to cope up with the ever changing technology we are always trying to reinvent ourselves. We are committed to address your needs with solutions that are highly reliable and scalable.
Chabez Tech always looks to develop out of the box solutions to run the business operations in much more efficient way. We strive to excel and focus on customer engagements so that we always exceed the expectations of our clients. Also provides innovative solutions so that our clients are leading the way and have a competitive advantage over others. We measure our success with the success of our clients.
Chabez Tech has a dedicated team which is expertise, has rich experience and strong knowledge amongst most of the domains. This perfect blend strives to work towards customer satisfaction and relationship with the clients. Our team works round the clock and available at your service 24/7. We have a passionate team which is always striving for customer satisfaction.
Chabez Tech is committed to provide high quality software and IT solutions for your needs. We have a created a place for us in this industry with a basket of existing Domestic and International projects. We are expertise in ERP, Application development, IT Training, DBA services, BPO services and other IT solutions.
Our solutions are unique and customized solutions. Every business has different needs to be fulfilled hence our solutions can be fully customized. Chabez Tech adopts a strategy which is best suited for any specific needs. We provide best solutions for helping you to grow your business. We ensure that we have strong relationship based on trust and integrity which helps us in a long lasting relationship with our clients.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs