big data engineer (spark) Jobs in austin, tx

Refine Results
1 - 20 of 73 Jobs

Big Data Engineer

Info Way Solutions

Austin, Texas, USA

Contract

Title: Big Data Engineer Location : Austin TX or Sunnyvale, CA Job Description: In the role of Lead Data Engineer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation

Big Data Engineer/Admin

Ztek Consulting

Austin, Texas, USA

Contract, Third Party

Required Skills - Apache HadoopNice to have skills - Shell scripting ,Python, Hive, Apache Sentry, Impala, Hadoop Administration, Delivery Management, Risk Management, Project Stakeholder Management, Cloudera Data Platform, Hadoop\Big Data AdminPerson will be responsible to Perform Big Data Administration and Engineering activities on multiple Hadoop Kafka Hbase and Spark clustersWork on Performance Tuning and Increase Operational efficiency on a continuous basis Monitor health of the platforms

Lead Big Data Engineer -12+ years

ClifyX

Austin, Texas, USA

Contract, Third Party

ClifyX group is an award winning IT Consultancy formed in 1998. Our Mission is to provide our clients with Optimal Technology solutions that are effective and within budgets. We specialize in helping Organizations to review their strategic SOW Projects/Talent needs and implement high value and cost effective solutions to increase profitability and efficiency. Our consulting capabilities include expertise in Cloud, Artificial Intelligence, Data Analytics and compliance aspects of Cyber Security d

Software Engineer (Big Data), Ai & Data Platforms

Apple, Inc.

Austin, Texas, USA

Full-time

Summary Do you love understanding every detail of how new technologies work? Join the team that serves as Apple's nerve center, our Information Systems and Technology group. There are countless ways you'll contribute here, whether you're coordinating technology needs for product launches, designing music solutions for retail locations, or ensuring the strength of in-store Wi-Fi connections. From Apple Pay to the Apple website to our data centers around the globe, you'll help design and manage t

DevOps Engineer - Big Data Platform

Apple, Inc.

Austin, Texas, USA

Full-time

Summary Apple's Applied Machine Learning team has built platforms for several large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business, we manage many streams of Apple-scale data. We bring it all together and extract the value. We do all this with an exceptional group of softwa

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Bigdata Hadoop Engineer

Softsol Resources Inc

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S

Big Data Engineer

ADDSOURCE

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme

Staff Software Engineer - Big Data

ServiceNow, Inc.

Remote or San Diego, California, USA

Full-time

Company Description At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can't wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make t

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Senior Big Data Engineer

ADDSOURCE

Remote

Third Party

Senior Big Data Engineer 12+Years Remote Mandatory Skills: Spark, Scala EMR and AWS Requirements: Bachelor's degree preferably in Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, technical guida

Software Engineer- Data ASE Analytics Engineering

Apple, Inc.

Austin, Texas, USA

Full-time

Summary Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish. Would you like the stimulation and challenges of building world-class, extraordinary scalable systems that power App Store, ?Music, ?TV+, ?Fitness+, Payments and many more? Then this is the opportunity for you at Apple! We strive to provide a flawless ex

Lead Data Engineer (Security Focus)

Iceberg

Remote

Full-time

My client is a leading innovator in financial technology and trading, dedicated to pushing the boundaries of technology to create impactful solutions. We are currently seeking a talented Lead Data Engineer with a strong background in software engineering and experience in data engineering, particularly in the realm of security. As the Lead Data Engineer with a focus on security, you will play a pivotal role in leading the development and optimization of data pipelines, tools, and products to enh

Data Engineer

Galaxy i Technologies, Inc.

Austin, Texas, USA

Contract

Hi Everyone W2 Contract only Immediate Requirement & Long term contract Note: We can accept all visa types and Sure shot interview Job Title : Data Engineer Location: Austin, TX (Hybrid Model like 3 days in a week onsite) Job Description: Bachelor's degree or foreign equivalent required from an accredited institution. At least 8 years of experience in Information Technology. At least 3 years of hands-on experience with Hadoop distributed frameworks while handling large amounts of big data u

Senior Big Data Engineer Remote

Vbeyond Corporation

Remote

Third Party, Contract

Skills and Qualifications: Technical Expertise: Proficient in programming languages like Python, Java, Scala. Strong experience with big data tools (e.g., Hadoop, Spark) and data pipeline and workflow management tools (e.g., Airflow, Luigi). Database Proficiency: Extensive experience with relational SQL databases and NoSQL databases. Knowledge of cloud services like AWS, Azure, or Google Cloud is a plus. Analytical Skills: Strong analytical skills with the ability to collect, organize, analyze,

Software Engineer (Data Solutions), IS&T Ai & Data Platforms

Apple, Inc.

Austin, Texas, USA

Full-time

Summary Do you love understanding every detail of how new technologies work? Join the team that serves as Apple's nerve center, our Information Systems and Technology group. There are countless ways you'll contribute here, whether you're coordinating technology needs for product launches, designing music solutions for retail locations, or ensuring the strength of in-store Wi-Fi connections. From Apple Pay to the Apple website to our data centers around the globe, you'll help design and manage t

Sr Software Engineer (Data Solutions), IS&T Ai & Data Platforms

Apple, Inc.

Austin, Texas, USA

Full-time

Summary Are you meticulously organized and highly observant? Join our Information Systems and Technology group and play a vital function on one of two Apple teams: Software and Services and Corporate Functions. From Apple ID to the Apple website to our data centers around the globe, our diverse collection of engineers, designers and creators manage the massive systems and services that so many people rely on every single day. We also build the custom tools that empower other Apple employees to

Senior Data Engineer

Aria Consulting Services LLC

Austin, Texas, USA

Contract

Request you to get in touch with us if available for the below immediate opportunity. Please email me your resume and contact number at your earliest. Role Senior Data Engineer Location Austin, TX Duration Long term Role, Skills, Responsibilities: Data Engineer with experience in implementing and scaling data collection, storage, processing, and filtering for fine-tuning large language models (LLMs) within Conversational Engineering. This role provides the exciting opportunity to collaborate clo

HR Data Engineer

General Motors

Austin, Texas, USA

Full-time

Description Workplace Status: Hybrid - This role is categorized as hybrid. This means the successful candidate is expected to report to their primary work location three times per week, at minimum, or other frequency dictated by the business. The Role: We are seeking a highly skilled and experienced Data Engineer to join our HR Data and Analytics Team. As an Experienced Data Engineer, you will play a crucial role in enabling analytics across the HR organization, empowering data-driven decision-

Senior HR Data Engineer

General Motors

Austin, Texas, USA

Full-time

Description Workplace Status: Hybrid - This role is categorized as hybrid. This means the successful candidate is expected to report to their primary work location three times per week, at minimum, or other frequency dictated by the business. The Role: We are seeking a highly skilled and experienced Senior Data Engineer to join our HR Data and Analytics Team. As a Senior Data Engineer, you will play a crucial role in enabling analytics across the HR organization, empowering data-driven decision