Engineer - Big Data Stream-Processing

company banner
Intelliswift Software Inc
Stream Processing, Spark
Contract W2, Contract Independent, 12 Months
Depends on Experience
Work from home available

Job Description

Title: SW ( big data processing ) Location: Seattle/Remote, WA, United States
Description:

You will be responsible for the stream processing platform used for analytics and machine learning of worldwide Siri and Search events. We process a triple digit billion events per day. To run our environment efficiently, we drive for proper monitoring, alerting and automation. The team’s goal is to ensure the reliability and performance at the highest level.

Manage one of the largest infrastructure supporting hundreds of millions of Siri and customers
Diagnose, fix, improve, and automate complex issues across the entire stack to ensure maximum uptime and performance
Take part in designing and building out our next generation realtime data processing infrastructure and push our services to the next level
Harden and launch new data models and data pipelines in production
Establish SLA’s for all data sets and applications running in production
Advise other teams (within and outside of Siri) on proper integration of our platform
Build relationships with Data Scientists, Product Managers and Software Engineers to understand data needs
Manage the infrastructure which powers ETL, Analytics, and Privacy Efforts within AIML
Skills
.
Passionate about Data Processing Technologies
Extensive programming experience in Java, Python or Go
Extensive experience using data processing frameworks such as Apache Flink or Apache Spark Streaming
Experience configuring and troubleshooting data processing frameworks (e.g. Flink, Spark Streaming, Samza, Kafka Streams or Storm)
Experience with alerting, monitoring and remediation automation in a large scale distributed environment
Experience setting up and managing public cloud infrastructure on AWS (EKS, S3, IAM, etc)
Education
.
BS, MS, or PhD degree in Computer Science or equivalent and 5+ years experience in data technologies



Company Information

Intelliswift Software, Inc. is a premier software solutions and services company headquartered in Silicon Valley, with offices across the United States and India. The company has a proven track record of delivering results through its global delivery centers and flexible engagement models for over 450 brands ranging from Fortune 100 to growing companies. Intelliswift provides a variety of services including Enterprise Applications, Software Product Development, Mobility & Collaboration, Big Data/BI, Cloud Solutions, and Team Augmentation.

Dice Id : 10108150
Position Id : DD_21-10859
Originally Posted : 2 months ago

Similar Positions at Intelliswift Software Inc

QA Data Engineer
  • Seattle, WA
  • 2 weeks ago
Infrastructure Systems Engineer
  • Seattle, WA
  • 2 weeks ago
Remote - Sr. Big Data and Pipeline Engineer
  • California City, CA
  • 2 weeks ago
Data Scientist
  • Burbank, CA
  • 2 weeks ago