Big Data jobs | Dice.com

Excellent Opportunity - PySpark Developer in Irving, TX- Fulltime.

Irving, Texas

•

Today

Hi, We are currently looking for a PySpark Developer for a full-time opportunity in Irving, TX with one of our global clients. If you are interested, please reply with your updated resume and let me know a convenient time to discuss the opportunity. Job Title: PySpark Developer Experience: 8- 10 Years Location: Irving, TX- Hybrid Duration: Fulltime Role Overview: Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines and data transformation

Easy Apply

Full-time

Big Data Architect - 10+ years

Hybrid in Irving, Texas

•

6d ago

About LTIMindtree LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by

Easy Apply

Full-time

98015 - 146600

Big Data Engineer

Hybrid in Reston, Virginia

•

Today

Position Summary The Big Data Engineer will design, develop, and maintain big data ecosystem to support advanced analytics and data-driven decision-making across engineering, procurement, and construction workflows. This role is pivotal in enabling scalable, secure, and efficient data solutions for projects in semiconductor, electric vehicle, advanced materials, and data center sectors. Job Dimensions Supervision Received: Reports to Digital Solutions Lead and works under general direction.Super

Easy Apply

Contract

Depends on Experience

Java/Scala Big Data Engineer

Austin, Texas

•

21d ago

Senior Java/Scala Big Data Engineer Location: Sunnyvale, CA or Austin, TXCandidate Type: Hands-on technical coder Core requirementsStrong hands-on Java and/or Scala developmentApache Spark development and performance tuningApache Iceberg implementation and query optimizationETL/data pipeline design and developmentBig Data technologies: Spark, Hive and KafkaData lakehouse architecture and large-scale datasetsSQL and distributed query-performance tuningKubernetes, Docker and Helm exposureCI/CD ex

Easy Apply

Contract

$135,000 - $140,000

Big Data ML Engineer (Only on W2)

Hybrid in Plano, Texas

•

13d ago

Job Title: Big Data ML Engineer Location: Plano, TX (Hybrid) Duration: 7 Months Job Description: Job Description: Design, build, and operate large-scale batch and real-time data pipelines that move, transform, and publish data across the enterprise with high reliability and low latency Collaborate with Agile teams to architect end-to-end data solutions from ingestion and orchestration through to event streaming and downstream delivery 4+ years of experience building or operating data pipeline

Easy Apply

Contract

Depends on Experience

Big Data Engineer Python/Scala, Spark, Hadoop (LOCAL CANDIDATES ONLY)

Hybrid in Arlington, Virginia

•

Today

Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable itExperience building robust and efficient data pipelines end-to-end with a strong focus on data qualityHigh proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platformsExperience in building and deploying production-level data-driven

Easy Apply

Third Party, Contract

Depends on Experience

Big Data Engineer – Python/Scala, Spark, Hadoop

Arlington, Virginia

•

7d ago

Role: Big Data Engineer Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Exp Level : 6 to 12 Year Position : 2 Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality High proficiency in using Python or Scala, Spark, Hadoop platforms & tools

Easy Apply

Full-time, Third Party

$120000 - $135000

Big Data Engineer

No location provided

•

Today

Job Title:- Big Data Engineer Location:- Remote with occasional travel required to Parsippany or Richmond VA Duration:- Contract to hire Job Description Job Responsibilities: Client is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. You'll engineer batch/CDC/streaming pipelines, mode

Easy Apply

Contract

AWS S3 Storage Engineer

Irving, Texas

•

3d ago

Position: Storage Engineer (S3) Location: Irving TX Job Type: Fulltime Storage Engineer (S3): Big Data, Hadoop, S3, IaC, Terraform, CI/CD, AWS, Python Job Description Design and operate object storage solutions. Manage storage performance and lifecycle policies. Implement data security and encryption controls. Support data platform workloads. Optimize storage cost and capacity. Storage configurations and policies. Performance and usage reports. Operational documentati

Easy Apply

Full-time, Third Party

Depends on Experience

Technical Project Manager

Woodlawn, Maryland

•

27d ago

This position requires a FTF interview in MD at the client site. Onsite role Key Required Skills: Strong experience in managing software lifecycles, driving process improvements, and aligning technical solutions with business objectives. Position Description Lead end-to-end delivery of complex technical projects, including software development, cloud migration, and infrastructure modernization.Collaborate with engineering, architecture, and DevOps teams to define technical requirements, soluti

Easy Apply

Contract

70 - 80

Storage Engineer (S3) / Storage Specialized Cloud Engineer

Irving, Texas

•

3d ago

Position: Storage Engineer (S3) / Storage Specialized Cloud EngineerIrving, TX|8 - 10 yearsof experienceRole: Fulltime / Permanent roleJob Description:Must have exp with Big Data, Hadoop, S3, IaC, Terraform, CICD, AWS, PythonDesign and operate object storage solutions.Manage storage performance and lifecycle policies.Implement data security and encryption controls.Support data platform workloads.Optimize storage cost and capacity.Storage configurations and policies.Performance and usage reports.

Easy Apply

Full-time

95000 - 110,000

Big Data Engineer / AWS Data Engineer (Hybrid Onsite - In Person Interview)

Hybrid in Quincy, Massachusetts

•

17d ago

Job Title : Big Data Engineer / AWS Data Engineer Location: Quincy, MA (3- 4 days a week Hybrid onsite) Duration : Long term contract Contract: W2 / C2C Job Description: Key Skills: Databricks, AWS, SQL, Scala, Bigdata Overall experience 9-12 years in Scala-Spark data engineering and Data pipeline designExperience in databricks preferredHands on experience in Design and development of Ingestion pipeline, ETL pipeline and jobs in Databricks. Databricks workspace and cluster configuration and Job

Easy Apply

Contract

70 - 80

Big Data Engineer_ W2 Role

New York, New York

•

10d ago

Position Title: Senior Data Engineer Location: New York, NY (5 days Onsite) Duration: 6-month (Contract to hire) Job ID 308949-1 Rate - $80 - $85 Must Have: 510+ years of Big Data Engineering experience. Expert-level Python programming. Strong Apache Spark. Solid Data Structures & Algorithms. Experience building large-scale distributed applications. Experience with AWS EMR and Glue ETL Strong software engineering fundamentals with system design capability. Ability to confidently explain every

Easy Apply

Contract

80 - 85

Data engineer (In person interview is required)

Dallas, Texas

•

29d ago

Job Description:We are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing, building, and optimizing our next-generation scalable data pipelines. This position requires expertise in processing massive datasets using cutting-edge technologies like Apache Spark, PySpark, and Hive within a dynamic cloud environment. Your primary objective will be to ensure the utmost data reliability, speed, and efficiency, providing a robust foundation for downstream business i

Easy Apply

Full-time

120,000 - 140000

Principal Software Engineer Big Data & Cloud

Rockville, Maryland

•

30+d ago

Lead Software Engineer (Big Data, Spark, AWS, Full Stack) Location: Rockville, MD or Tysons Corner, VA Work Setting: Onsite Job Descripton: We are seeking a highly experienced Lead Software Engineer to design, develop, and optimize enterprise-scale applications and big data platforms. The ideal candidate will have strong expertise in Apache Spark, AWS Cloud, Full Stack Development, System Design, and Software Engineering best practices. Required Skills:7+ years of Software Engineering experienc

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer with Devops

Hybrid in Dallas, Texas

•

30+d ago

Data Engineer with Devops Location : Pittsburgh, PA / Cleveland, OH / Dallas, TX Required Qualifications Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.4+ years of experience in Data Engineering or Big Data development.Hands-on experience with Python, PySpark, Java, Kafka, Hadoop, REST APIs, and SQL.Strong analytical and problem-solving abilities.Ability to work effectively in both team-oriented and independent environments.Preferred Skills Experie

Easy Apply

Full-time

$120,000 - $140,000

Data Engineers with Lumi

Hybrid in Phoenix, Arizona

•

Today

Data Engineers with Lumi Long term contract Phoenix, AZ (F2F interview is mandatory) Direct client - Immediate client interview We are looking for 2 highly skilled Data Engineer with a solid experience of building Bigdata, Google Cloud Platform Cloud based ETL Pipelines and Spark applications, strong problem-solving skills, articulate communications, and a collaborative mindset.Highly prefer AXP LUMI experience. Hands-on software development experience with Big Data & Analytics solutions like

Easy Apply

Contract, Third Party

Depends on Experience

Data Architect

Remote

•

Today

We are looking for an experienced Cloud Data Architect to drive the growth of our Cloud & Data Engineering business through client advisory, consulting, solution architecture, and presales. The ideal candidate should have strong expertise in Databricks, Azure/AWS, modern data engineering, cloud data architecture, AI/BI, and data modernization, along with experience in research, innovation, capability building, and mentoring talent. Qualifications: Bachelors degree in computer science, engineer

Easy Apply

Full-time

180,000 - 200,000

Software Engineering - Full Stack Developer Advanced

Remote

•

10d ago

Job Title: Software Engineering - Full Stack Developer Advanced Location: Houston, TX Duration: 6 Months + Extension Bill Rate : $88/hr. Job Type: W-2 Contract Client: To Be Discussed Later Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD Overview: Team is building a unified data platform supporting the movement and use of data for analytical/reporting needs. (Note: this is not a data migration project) Technical Requirements Expert in Full Stack design technique as well as experience work

Easy Apply

Full-time

$120,000 - $140,000

Ab Initio Data Engineer

Berkeley Heights, New Jersey

•

25d ago

Key Responsibilities: Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.Implement event-driven data pipelines using Kafka, MQ, and file streams.Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-once" processing.Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.Proactively monitor live production streams to ensure 24/7 r

Easy Apply

Third Party, Contract

60 - 70