Visionary Innovative Technology Solutions

Apply Now

Big Data Engineer-Hybrid-Full time

Hybrid in Dallas, TX, US • Posted 9 hours ago • Updated 9 hours ago

Full Time

No Travel Required

Hybrid

Depends on Experience

Visionary Innovative Technology Solutions

Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

Big Data
Amazon Web Services
PySpark
Python

Summary

We are seeking a skilled Big Data Developer with strong expertise in AWS Cloud, Hadoop Ecosystem, and PySpark. The ideal candidate will be responsible for designing, developing, and supporting scalable data engineering solutions while working closely with business and technology teams to deliver enterprise-grade data platforms.

Key Responsibilities:

Design, develop, test, and support large-scale Big Data and data engineering solutions.
Build and maintain scalable data pipelines using PySpark and Hadoop technologies.
Gather business requirements and convert them into technical specifications and data solutions.
Develop and optimize ETL/ELT workflows for structured and unstructured data processing.
Implement cloud-native data solutions leveraging AWS services.
Participate in architecture discussions, effort estimation, and solution design activities.
Ensure adherence to coding standards, security guidelines, and development best practices.
Monitor and troubleshoot data processing workflows and production issues.
Collaborate with cross-functional teams, business stakeholders, and project managers.
Contribute to CI/CD implementation and automation for data engineering projects.

Required Skills & Qualifications:

6–8 years of experience in Big Data and Data Engineering.
Strong hands-on experience with PySpark and Hadoop Ecosystem.
Experience with AWS Cloud services including EKS, S3, EMR, Glue, and Lambda.
Proficiency in Scala or Python for data processing and automation.
Strong understanding of distributed computing and large-scale data processing.
Experience designing and implementing enterprise data pipelines.
Knowledge of Snowflake and modern cloud data warehousing concepts.
Understanding of CI/CD pipelines and DevOps practices.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and stakeholder management abilities.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91020323
Position Id: 8989397
Posted 9 hours ago

Company Info

About Visionary Innovative Technology Solutions

VITS provide staffing and recruitment services along with technology consulting to more than 50+ clients globally Our skilled & expertise professionals help clients to manage varying skill needs, skills gaps and changing staffing needs to encounter project deadlines. VITS staff augmentation services provide skilled resources which assist clients to develop, maintain, manage and support their applications. Our vigorous pursuit for excellence in hiring, delivery model, work ethics, and approach has enabled us to become a highly trusted & preferred recruitment solution provider.

Go to company profile

Contact the job poster

Deepak Kumar

Talent Acquisition Specialist @ Visionary Innovative Technology Solutions

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Python Developer-Hybrid-Full Time

Hybrid in Dallas, Texas

•

Today

We are seeking an experienced Python Developer to design, develop, and maintain scalable applications and data-driven solutions. The ideal candidate will have strong expertise in Python programming, API development, cloud technologies, and database management, with the ability to deliver high-quality software solutions in an Agile environment. Key Responsibilities:Design, develop, test, and deploy applications using Python.Build and maintain RESTful APIs and microservices.Develop scalable backen

Easy Apply

Full-time

Depends on Experience

Big data developer- Full Time Role - (8+ Years profiles)

Hybrid in Tampa, Florida

•

6d ago

Job Title: Big datadeveloper (8+ Years profiles) Work Location:Tampa, Florida (Hybrid) Duration: Full Time Role Skills Mandatory Skills :AWS Cloud Architecture, Big Data Hadoop Ecosystem Good to Have Skills :Apache Spark, AWS Code Pipeline, Data Architecture, Python Job Descriptions Skills Big Data PySparkResponsibilities Ensure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure continual knowledge management Adherence to

Easy Apply

Full-time

Depends on Experience

Sr. .Net Developer (10+years) - Full Time Role

Hybrid in Fort Myers, Florida

•

Yesterday

Role: Sr. .Net Developer Location:: Fort Mill, SC-Hybrid Duration: Full Time About the Role We are looking for a highly skilled Sr. .NET Developer with strong experience in enterprise application development using .NET technologies, cloud-native architecture, and modern frontend frameworks. The ideal candidate should have hands-on experience with AWS cloud services, Angular, and exposure to Agentic AI or other AI-driven development tools/platforms. Prior experience in the Wealth Management or

Easy Apply

Full-time

Depends on Experience

Launch Darkly DevOps Architect

Hybrid in New York, New York

•

3d ago

Job Description: Launch Darkly DevOps Architect Duration: Fort Mill, SC or NYC, NY (Hybrid) Long Term Role Summary We are seeking a hands-on Lead / Architectwith deep expertise in AWS DevOpsand strong subject matter expertise in LaunchDarkly. This role requires a senior technologist who can design, implement, and operationalize enterprise-grade feature management solutions, while also owning delivery and leading a small team. The ideal candidate has 13+ years of overall experience, with the las

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs