Apache Spark Jobs in Austin, TX

Refine Results
21 - 40 of 313 Jobs

Senior Software Engineer - Data Delivery

General Motors

•

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX, Warren, MI, or Roswell, GA three times per week, at minimum. The Role The Data Delivery team is seeking a Senior Software Engineer with a proven track record building large scale data streaming platforms. The ideal candidate will play a crucial role in developing and maintaining data-related systems comprising high throughput data streams, data curation and data storage /
Posted 34 days ago | Updated 5 hours ago

ML Data Infrastructure Engineer

DVARN

•

Remote

Contract

Role: ML Data Infrastructure Engineer Location: Sunnyvale, CA OPEN FOR 100% REMOTE Duration: 12 Months Candidates should have strong experience in Deep Leaning ML frameworks and model serving technologies which is lacking in most of the resumes. JD: 8+ years of software engineering experience, with 3+ years in ML serving/infrastructure\ Strong expertise in container orchestration (Kubernetes) and cloud platforms Experience with model serving technologies (TensorFlow Serving, Triton, KServe) Deep
Easy Apply
Posted 29 days ago

Sr. Big Data Developer - W2 Resource Only

Nasscomm, Inc.

•

Remote

Contract

Big Data Developer - Minimum 6 yrs of experience in Cloud, Big Data, Spark & Scala - Must have skill : Experience in Spark and Scala with exposure about cloud platforms ( AWS, Azure, Google Cloud Platform) for big data processing and storage - Strong experience in Azure DLS - Strong experience in Databricks, data pipelines - Experience in Hadoop seeking someone with strong backend development expertise, particularly in Java (Spring framework) - Agile delivery experience
Easy Apply
Posted 8 days ago | Updated 4 hours ago

Software Engineering Senior Advisor-Hybrid

Cigna

•

Remote or Austin, Texas, USA

Full-time

The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Senior Contributor Career Track Role with Cigna-Evernorth Services Inc. Requirements- Participate in the delivery of the definitive enterprise information environment that enables strategic decision-making capabilities across the enterprise via analytics and reporting; Provide counsel and advice to top management on significant engineering matters, often requiring coordination between organizations; Serv
Posted 47 days ago | Updated 8 hours ago

Lead Healthcare Data Scientist with Azure

VLink Inc

•

Remote

Contract

Job Title: Lead Healthcare Data Scientist with Azure Location: Remote (EST Only) Employment Type: Contract Duration: 6 month initial contract About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients. Job Description: Lead Healthcare Data Scientist Key Skills: Healthcar
Easy Apply
Posted 4 hours ago

Data Engineer (Middle) ID35916

Agile Engine

•

Remote

Full-time

What you will do Build and support ETL pipelines;Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;Working with Terraform to build AWS infrastructure;Analyze sources and build Cloud Data Warehouse and Data Lake solution.Must haves 3+ years of professional experience with Python;3+ years of pr
Easy Apply
Posted 3 days ago | Updated 3 days ago

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

•

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet
Easy Apply
Posted 2 days ago | Updated moments ago

Staff Full Stack Software Engineer- Quality Risk Management

General Motors

•

Austin, Texas, USA

Full-time

Job Description Workplace Classification: Hybrid : This role is categorized as hybrid. This means the candidate is expected to report to their primary work location (Austin, TX or Warren, MI) three times per week, at minimum, or other frequency dictated by the business. The Role: The Staff Full Stack Software Engineer for Quality Risk Management is responsible for developing software applications that support the Failure Mode and Effects Analysis (FMEA) business process, spanning the product d
Posted 35 days ago | Updated 5 hours ago

Data Engineer III

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer . Responsibilities: * Developing/refactoring/optimizing real time data processing applications using apache Flink * Developing/refactoring/optimizing batch data processing applications using apache spark * Migration of real time data pipelines to isolated kafka infrastructure and coordinate migration efforts with consumers * Operational monitoring and on-call support for business critical applications *
Posted 7 days ago | Updated 1 hour ago

Principal Software Engineer

Cisco Systems, Inc.

•

Austin, Texas, USA

Full-time

Who We Are Cisco ThousandEyes is a Digital Experience Assurance platform that empowers organizations to deliver flawless digital experiences across every network - even the ones they don't own. Powered by AI and an unmatched set of cloud, internet and enterprise network telemetry data, ThousandEyes enables IT teams to proactively detect, diagnose, and remediate issues - before they impact end- user experiences. ThousandEyes is deeply integrated across the entire Cisco technology portfolio and
Posted 60+ days ago | Updated 8 hours ago

Data Engineer (Only W2)

Alpha Silicon

•

Austin, Texas, USA

Contract

Title: Data Engineer + Java Exp Location: Austin, TX Long Term Contract W2 Roles Only (No C2C) Detailed Job Description Experience of building data pipelines using Java and Scala. Strong working experience of Apache Flink, Kafka, Spark, Scala, Airflow. Assembling large, complex sets of data that meet non-functional and functional business requirements Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizin
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Staff Software Engineer

General Motors

•

Austin, Texas, USA

Full-time

Job Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX three times per week, at minimum. The Role The Vehicle Data Engineering team is seeking a skilled Staff Software Engineer to take on a key role in the development of innovative data storage and retrieval systems for vehicle data. The ideal candidate will possess a robust background in processing large volumes of data at high speeds. In this role, you will be responsible for
Posted 36 days ago | Updated 5 hours ago

Data Engineer

Raas Infotek LLC

•

Remote

Contract

Position: Data Engineer Type: W2 Contract We re looking for a Data Engineer to design, build, and optimize data pipelines that support enterprise analytics and digital transformation initiatives. This role is ideal for someone who thrives in a fast-paced, data-driven environment and has a strong background in modern data engineering tools and cloud platforms.Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using modern data frameworks Collaborate with data analysts, ar
Easy Apply
Posted 3 hours ago

Sr. Lead Data Engineer/Architect

iTech US, Inc.

•

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda
Easy Apply
Posted 2 days ago | Updated 1 day ago

Data Engineer (Middle/Senior) ID34675

Agile Engine

•

Remote

Full-time

What you will do Collaborate with engineers, architects, data scientists, analytics teams, and business stakeholders in an Agile setup;Build, and support both Cloud and On-Premise enterprise data infrastructure;Design and implement robust, reusable, and scalable data pipelines to automate ingestion, processing, and delivery of both batch and streaming data (structured and unstructured);Develop data APIs and delivery services to support critical business processes, analytical models, and ML appli
Easy Apply
Posted 24 days ago

Palantir Data Integration Engineer

CogniSoft Technologies

•

Remote

Contract

Job Title: Palantir Data Integration EngineerLocations: 100% REMOTE Job Description:A Palantir Data Integration Engineer is responsible for designing, developing, and maintaining data integration solutions using Palantir's software platform. In this role, you will work closely with stakeholders to develop scalable data pipelines, build robust applications, and integrate various data sources to drive impactful decision-making. You ll contribute to the full software development lifecycle, from req
Easy Apply
Posted 28 days ago

Senior Data Engineer

Precision System Design Inc.

•

Remote or Cleveland, Ohio, USA

Contract

Are you an experienced Data Engineer looking for a change? Do you want to work with cutting edge technology for an established Fortune 100 company on a fully remote basis? Our client is looking for a Data Engineer to help develop, maintain, and enhance the capabilities of their data platform. You'd build out data pipelines to support data science models to enable automated data processing and increased efficiency. You'd also help support packaging and deploying models to production, and developi
Easy Apply
Posted 18 days ago | Updated 2 hours ago

Server Field Applications Engineer - Dell (FAE)

AMD (Advanced Micro Devices)

•

Austin, Texas, USA

Full-time

WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences - the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world's most important challenges. We strive for execution excellenc
Posted 53 days ago | Updated 8 hours ago

AWS Databricks Architect

Chabez Tech LLC

•

Remote

Contract

Position: AWS Databricks Architect Location: Remote Job Description: We are seeking a highly experienced AWS Databricks Architect to lead the architecture and design of scalable data solutions within the AWS cloud ecosystem for ThermoFisher. The ideal candidate will bring deep expertise in cloud-native data processing, analytics, and architecture, along with strong leadership capabilities to drive large-scale projects. Responsibilities:Design and implement end-to-end cloud data architectures us
Easy Apply
Posted 2 days ago

Databricks Architect

P2PSoftTek Inc

•

Remote

Contract

Looking for 15 plus years of overall experience Need Financial Domain Experience Responsibilities Design, implement, and deploy data platforms at scale in both public and private clouds Guide clients in establishing their data strategy, including data governance, data architecture, and data quality management Educate clients on modern technologies, architectures, and approaches for data & analytics Drive discovery phases, understand business problems, and propose technical solutions to address t
Easy Apply
Posted 6 days ago