Apache Spark Jobs in Austin, TX

Refine Results
1 - 20 of 316 Jobs

Spark Architect

DCE Infosec LLC

Remote

Full-time

**No Employer **Must have 15 to 20+ years of experience Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Job DescriptionHandson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data oper

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements

Big Data/Spark Principal Architect

AIT Global, Inc.

US

Full-time

Job Title: Big Data/Spark Principal Architect Location: Remote Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Years Of Experience15 to 20 Years Job Description: Hands on with Spark (data frame), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance,

Senior Java Spark Developer or Big Data with Spark and Java

Culinovo

Austin, Texas, USA

Contract

Job Title: Senior Java Spark Developer or Big Data with Spark and Java Location: Austin, TX or Sunnyvale, CA (Hybrid-3 Days Onsite) Work Mode: Hybrid Duration: Long Term Note: We require candidates on our W2. Independent Visa candidates can apply like EAD's, s, s, etc. Experience Level: 9+ years Job Summary: We are seeking a Senior Java Spark Developer with expertise in Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ide

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid

Principal Data Engineer

EPSoft Technologies LLC

Austin, Texas, USA

Full-time

Role: Principal Data Enginner Locations: Austin, Tx & Fort Mill, SC Hybrid role/ Full Time We are looking for a skilled Principal Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives. Key Responsibil

Full Time opportunity: Need Locals: QA Manager -- Austin, TX / F2F Interview

Intellisoft Technologies

Austin, Texas, USA

Full-time

Hi, Position; QA Manager Location: Austin, TX (Face to face interview) Big Focus for this role: ETL Testing Lead (Or similar experience) Python (Modem data pipelines, also need pandas libraries) SQL (Azure environment) ADF SSIS (Legacy) Databricks Snowflake (Nice to have, sounds like their sunsetting this) Testing on pipelines (so Spark, Pyspark, ADF) API - Postman

Database Developer

Lorvin Technologies

Austin, Texas, USA

Contract, Third Party

10+ years. Heavy in Oracle & PostgreSQL MUST have Coding level Oracle & PostgreSQL on Google Cloud Platform Design, implement, and maintain Oracle & PostgreSQL DB solutions on the Google Cloud Platform. Collaborate with development teams to optimize data models, queries, and database performance. Perform Oracle & PostgreSQL DB installations, upgrades, and patch management following best practices. Monitor and ensure the availability, integrity, and security of Oracle & PostgreSQL databases. Impl

Staff Data Engineer, Vehicle Telematics

General Motors

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX three times per week, at minimum [or other frequency dictated by the business if more than 3 days]. The Role General Motors uses telematics data as a cornerstone of its software-defined vehicle strategy, enhancing safety, security, and product development for an exceptional customer experience. Analytical insights from this data lead to improvements in operational efficienc

Principal Electrical Engineer-Power

Dell Technologies

Round Rock, Texas, USA

Full-time

Principal Electrical Engineer-Power Our Electrical Engineering team puts the spark into the full hardware development lifecycle, from concept to production. It takes experts in system architecture definition, design, analysis, prototyping, sourcing, debugging and validation of layouts or routes to deliver state-of-the-art products for a changing world. We work closely with designers, cross-functional teams within Dell Technologies and suppliers to make sure electronic designs meet a range of re

Staff Site Reliability Engineer, Cell Software

Tesla Motors

Remote or Austin, Texas, USA

Full-time

Tesla is re-thinking how batteries are made from the ground up. We're designing new factories, new equipment, new processes and new software to rapidly scale battery manufacturing, globally. The primary bottleneck to Tesla's future expansion (and the transition to sustainable transport and energy storage) is our ability to produce and procure batteries - that's why we're innovating in-house, with our collection of world-class engineers, to redefine the industry. Software, data and automation all

Senior Platform Services and Solutions Manager

Athenahealth

Austin, Texas, USA

Full-time

Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. Position Summary: Platform Services & Solutions is a technical professional services organization responsible for developing and deploying athenahealth's Platform capabilities across athenahealth's customer base, from mature multi-specialty nationwide health systems to emerging startups. Our Platform Services and Solutions organization is focused on growing the healthcare

Senior Data Engineer

Apton Inc

Remote

Contract, Third Party

8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations pipelines using Databricks, Spark, Python, SQL, Scala, Kafka, Presto, Parquet, Streaming, events, bots, AWS/cloud ecosystem. Proficient in developing Micro Services and using AWS frameworks such as SQS, Strea

AWS Databricks Architect

Chabez Tech LLC

Remote

Third Party, Contract

Position: AWS Databricks Architect Experience: 15+ years Location: Remote Job Description:We are seeking a highly experienced AWS Databricks Architect to lead the architecture and design of scalable data solutions within the AWS cloud ecosystem for ThermoFisher. The ideal candidate will bring deep expertise in cloud-native data processing, analytics, and architecture, along with strong leadership capabilities to drive large-scale projects.Responsibilities:Design and implement end-to-end cloud d

Senior Principal Signal Integrity Engineer

Dell Technologies

Round Rock, Texas, USA

Full-time

Senior Principal Signal Integrity Engineer Our Electrical Engineering team puts the spark into the full hardware development lifecycle, from concept to production. It takes experts in system architecture definition, design, analysis, prototyping, sourcing & the debugging and validation of layouts or routes to deliver state-of-the-art products for a changing world. We work closely with designers, cross-functional teams within Dell Technologies and suppliers to make sure electronic designs meet a

Google Cloud Platform Data Architect / Engineer (Must work on W2)

Activesoft, Inc.

Remote

Contract

Required: Deep experienced data engineer/architect. Review ascend.io installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by Ascend.io.

Senior General Data Architect

Amiseq Inc.

Remote

Contract

Job Description: * 15+ years in IT experience with a minimum 7+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current knowl

Staff Software Engineer - Data Delivery

General Motors

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX three times per week, at minimum. The Role The Data Delivery team is seeking a Staff Software Engineer with a proven track record building large scale data streaming platforms. The ideal candidate will play a crucial role in developing and maintaining data-related systems comprising high throughput data streams, data curation and data storage / file system architectures, d

Senior Software Engineer - Data Delivery

General Motors

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX, Warren, MI, or Roswell, GA three times per week, at minimum. The Role The Data Delivery team is seeking a Senior Software Engineer with a proven track record building large scale data streaming platforms. The ideal candidate will play a crucial role in developing and maintaining data-related systems comprising high throughput data streams, data curation and data storage /

Software Engineering Senior Advisor-Hybrid

Cigna

Remote or Austin, Texas, USA

Full-time

The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Senior Contributor Career Track Role with Cigna-Evernorth Services Inc. Requirements- Participate in the delivery of the definitive enterprise information environment that enables strategic decision-making capabilities across the enterprise via analytics and reporting; Provide counsel and advice to top management on significant engineering matters, often requiring coordination between organizations; Serv