Apache Spark Jobs in Austin, TX

Refine Results
1 - 20 of 295 Jobs

Spark/Airflow Administrator

Sysmind, LLC

•

Austin, Texas, USA

Third Party, Contract

Strong knowledge of Apache Spark and Apache Airflow architecture Experience in Installing, Configuring, tuning, and monitoring Apache Spark and Airflow on Kubernetes Experience with performance tuning of Spark jobs and Airflow DAGs Understanding of Kubernetes fundamentals and experience deploying and managing software deployments on Kubernetes Experience with various Airflow Kubernetes operators (Kubernetes, Celery etc) Basic programming experience in Python or Java Overall 5-8 years of experien
Easy Apply
Posted 60+ days ago | Updated 7 hours ago

Data Scientist/Quant/Python/Apache/Spark/AWS

ITECS

•

Austin, Texas, USA

Third Party

Required Location: Hybrid/Midtown New York City or Austin, TX 3 days a week. Contract status: C-C preferred or W2 Interview Required: Video Candidates must be LOCAL to the NEW YORK or NEW JERSEY or Austin, TX area and COMMUTE into the office THREE TIMES A WEEK. NO RELOCATION CONSIDERED. Please send candidates even if they are over the target rate. The Client is flexible. Job Description: In terms of experience junior or mid (as long as they have the hard skills) No prior knowledge of financi
Easy Apply
Posted 7 days ago | Updated 10 hours ago

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - REMOTE

Provish Consulting

•

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candidates
Easy Apply
Posted 22 days ago | Updated 17 hours ago

Sr. Software Engineer, Scala/Java/Spark

Eliassen Group

•

Almont, Colorado, USA

Contract

Description: 100% Remote role. Our client is seeking a Software Developer who will help build next-generation data analytics platform utilizing the most advanced big data technologies. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $85 - $95 / hr. w2 Responsibilities: Design, architect, develo
Posted 11 days ago | Updated 8 hours ago

Machine learning Engineer-Onsite

BURGEON IT SERVICES LLC

•

Austin, Texas, USA

Third Party, Contract

Role : Machine Learning Engineer Location : Austin, TX(Need Locals) Onsite Duration : Long Term Contract Share the resumes with ajithatburgeonitsdotcom Responsibilities Design, develop, and deploy machine learning models to solve complex problems.Collaborate with data scientists, software engineers, and stakeholders to understand requirements and translate them into scalable solutions.Implement robust and efficient machine learning pipelines using Python and Rust.Conduct data analysis, feature e
Easy Apply
Posted 15 hours ago

DevOps Engineer

Info Way Solutions

•

Austin, Texas, USA

Contract

Job Description: Role; DevOps EngineerLocation: Carlson, TX Mandatory Skills: This role is needs Banking/finance domain which is Must.The below positions are for the asset management business unit. (experience in Fixed income, equities, high income, alternatives are a plus) Must have: DevopsDeep experience with CI/CD tools (Jenkins) & pipelines, Kafka, Kubernetes,Python, and Groovy,AWS cloud services experience Who are we looking for? Cloud Engineer (AWS cloud, Docker, Kubernetes, with ALM exper
Easy Apply
Posted 9 days ago

Backend Engineer

INSPYR Solutions

•

Austin, Texas, USA

Contract

Backend Engineer ABOUT THIS FEATURED OPPORTUNITY We are seeking a skilled and experienced Backend Engineer to play a pivotal role in developing and scaling new data pipelines for our Machine Learning solutions. This role involves designing and implementing Spark jobs, integrating with Solr for data indexing, and crafting business logic pipelines that connect with Oracle databases. You will work closely with QA and DevOps teams to ensure seamless end-to-end delivery into production for backend se
Easy Apply
Posted 2 days ago | Updated 3 hours ago

Internship, Data Engineer, Cell Manufacturing Software (Winter/Spring 2025)

Tesla Motors

•

Austin, Texas, USA

Full-time

Tesla is re-thinking how batteries are made from the ground up. We're designing new factories, new equipment, new processes, and new software to rapidly scale battery manufacturing, globally. The primary bottleneck to Tesla's future expansion (and the transition to sustainable transport and energy storage) is our ability to produce and procure batteries - that's why we're innovating in-house, with our collection of world-class engineers, to redefine the industry. Software, data, and automation a
Posted 23 days ago | Updated 9 hours ago

Senior Data Processing Platform Engineer

NVIDIA Corporation

•

Austin, Texas, USA

Full-time

Our technology has no boundaries! NVIDIA is building the world's most groundbreaking and state of the art compute platforms for the world to use. It's because of our work that data engineers and data scientists can advance their ideas. We are building a team who will be developing data processing and ML platform that can be used by data scientists to run large scale workloads and promoting a culture of MLOps. As a data processing platform engineer, you will design, implement and operate K8s bas
Posted 3 days ago | Updated 9 hours ago

Data Engineer (Only W2)

Alpha Silicon

•

Austin, Texas, USA

Contract

Title: Data Engineer + Java Exp Location: Austin, TX Long Term Contract W2 Roles Only (No C2C) Detailed Job Description Experience of building data pipelines using Java and Scala. Strong working experience of Apache Flink, Kafka, Spark, Scala, Airflow. Assembling large, complex sets of data that meet non-functional and functional business requirements Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizin
Easy Apply
Posted 60+ days ago | Updated 1 hour ago

Senior Machine Learning Engineer

MNTN

•

Remote or Austin, Texas, USA

Full-time

Job DescriptionJob DescriptionAt MNTN, we put our people first, full stop. This allows our company culture to be defined by our team members, and their shared values, like trust, ambition, quality, radical honesty, and compassionate leadership. It's why we all really love working for the Hardest Working Software in Television (and also why we were named one of Ad Age's Best Places To Work in 2024.) We pride ourselves on bringing unrivaled performance and simplicity to Connected TV advertising.
Posted 20 days ago | Updated 6 hours ago

Software Engineer - AI Services

eBay

•

Austin, Texas, USA

Full-time

At eBay, we're more than a global ecommerce leader - we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We're in this together, sustaining the futur
Posted 33 days ago | Updated 12 hours ago

Data Engineer IV, Spectrum Enterprise

Spectrum

•

Austin, Texas, USA

Full-time

Do you want to profile data to measure quality, integrity, accuracy and completeness while providing effective data solutions? You can do that. Ready to maintain scalable, reliable, consistent and repeatable systems that support data operations? As a Data Engineer IV at Spectrum Enterprise, you can do that. Spectrum Enterprise provides modern enterprise technology solutions that meet the unique needs of some of the country's biggest brands. If you're looking to build your most successful career,
Posted 22 days ago | Updated 9 hours ago

Technical Staff, Engineering Technologist (EE)

Dell Technologies

•

Austin, Texas, USA

Full-time

Technical Staff, Engineering Technologist (EE) From applied research to advanced engineering, the System Architecture team has the expertise to shape ground-breaking products, material, and processes. It's a fascinating field of work. We're involved in assessing the competition, developing technology and product strategies, and generating intellectual property. We lead technology investigations, analyze industry capabilities, and recommend potential acquisitions or vendor partner opportunities.
Posted 60+ days ago | Updated 29 days ago

Electrical Senior Principal Technologist

Dell Technologies

•

Austin, Texas, USA

Full-time

Electrical Senior Principal Engineering Technologist From applied research to advanced engineering, the Engineering Technologist team has the expertise to shape ground-breaking products, material, and processes. It's a fascinating field of work. We're involved in assessing the competition, developing technology and product strategies, and generating intellectual property. We lead technology investigations, analyze industry capabilities, and recommend potential acquisitions or vendor partner oppo
Posted 60+ days ago | Updated 29 days ago

Machine Learning Engineer (The AI Innovator)

Unreal Gigs

•

Austin, Texas, USA

Full-time

Job DescriptionJob DescriptionAre you an AI enthusiast with a passion for applying cutting-edge machine learning techniques to solve real-world problems? Do you thrive in environments where you can build intelligent models that drive data-driven decisions and power innovative products? If you re excited about using machine learning to develop and deploy scalable solutions that make an impact, then our client has the perfect role for you. We re looking for a Machine Learning Engineer (aka The AI
Posted 8 days ago | Updated 6 hours ago

Urgent Requirement : Snowflake Sr Developer

Aspire IT Experts Solutions LLC

•

Remote

Full-time

Job Requirements: - Experience in data integration activities, including architecting, designing, coding, and testing phases. - Architect the data warehouse and provide guidance to the team in implementation using Snowflake, SnowSQL, and other big data technologies. - Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, and big data modeling techniques using Python. - Experience in performance tuning of the Snowflake pipelines and the ability to troubleshoot issues quickly. - Extensi
Easy Apply
Posted 9 days ago | Updated 7 days ago

Data Engineer, Intern - Summer 2025

Visa

•

Austin, Texas, USA

Full-time

Job DescriptionJob DescriptionCompany Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose
Posted 3 days ago | Updated 6 hours ago

Need AWS Solution Architect -Remote -

Radiantze

•

Remote

Third Party, Contract

Title : AWS Solution Architect Location : Remote Duration : Long Term Plz dont send 7 or 8 Yrs Developer Profiles Required Skills : Bachelor's Degree in Computer Science, MIS, or related fieldExperience working with S3, EC2, Kinesis, API Gateway, SNS, SQS, Cloud Watch, Shield, Lambda, CloudFront and RedshiftHands-on experience with platforms such as AWS EMR, Hadoop, Spark, or Kafka and languages such as Python, JAVA, or SQLMultiple or more years of relevant experience in the solution architectu
Easy Apply
Posted 16 hours ago

Principal Data Scientist (The Data Whisperer)

Unreal Gigs

•

Austin, Texas, USA

Full-time

Job DescriptionJob DescriptionIntroduction: Are you a master of data, with the ability to extract meaningful insights from the most complex datasets? Do you have the expertise to develop advanced models that not only solve challenging problems but also drive strategic decisions? If you re a visionary data scientist who thrives on turning raw data into actionable intelligence, then our client has the perfect role for you. We re searching for a Principal Data Scientist (aka The Data Whisperer) to
Posted 8 days ago | Updated 18 hours ago