Apply Now

Staff Software Engineer (Apache Spark Poweruser / Committer)

Washington, WA, US • Posted 2 days ago • Updated 9 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

Streaming
Distributed Computing
Apache Parquet
Innovation
Collaboration
Open Source
Management
Data Centers
Cloud Computing
Scalability
Computer Science
Apache HTTP Server
Apache Kafka
Apache Spark
Kubernetes

Summary

Seeking extraordinary software engineers with deep experience in scalable batch and streaming processing systems. You will have a passion to push the limits of distributed computing frameworks to get every ounce of performance out of them. Looking for engineers with in depth knowledge of Spark and other related existing frameworks/systems such as Iceberg, Parquet. Also someone who will be passionate by the prospect of working reciprocally with other groups internal to Apple and also communities outside Apple.

As an engineer on our team, you will advance our data infrastructure, driving innovation by implementing cutting-edge capabilities and tools that will power Apple Services Engineering. You'll collaborate closely with a dedicated team of open source data experts (including Spark, Kafka, Iceberg committers amongst others) to enhance and automate our infrastructure, ensuring seamless management across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of the systems that support millions of users worldwide.\n

8+ years of professional experience professional experience.\nA successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems.\nExperienced Poweruser (at least 2 years of running production applications) of Apache Spark or Committer to Apache Spark.\nBS or MS degree in computer science or equivalent

Good knowledge of Apache Iceberg and Apache Kafka.\nExperience working on or building connectors from Spark to any of the data sources.\nKnowledge of Yarn, Kubernetes or other compute substrate.\n

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90733111
Position Id: 840ed3d4418025b6cba21eb05f24dc2e
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Software Engineering SMTS/MTS

Washington

•

Today

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate

Full-time

USD 117,200.00 - 223,900.00 per year

Software Engineering SMTS

Washington

•

Today

Full-time

USD 117,200.00 - 260,100.00 per year

Senior Software Data Engineer

Washington

•

Today

\\nPeople at Apple don't just build products - they craft the kind of experience that has revolutionized entire industries. The diverse collection of our people and their ideas inspire innovation in everything we do. Imagine what you could do here! Join Apple, and help us leave the world better than we found it.\\nThe Analytics Platforms & Experiences (APX) team is at the forefront of revolutionising Data Engineering. We drive significant increases in efficiency and productivity through a flawle

Full-time

Site Reliability Engineer - Kafka

Washington

•

Today

The Apple Service Engineering - Data Streaming SRE team is looking for Site Reliability Engineers with experience developing processes, tools, and automation for managing distributed systems in production environments. Our SRE team combines software engineering, systems engineering, and Devops practices to build and run large-scale, massively distributed, fault-tolerant systems. Our software ensures that Apple's services are reliable, scalable, and secure, and we leverage both open-source and ho

Full-time

Search all similar jobs