Overview
Skills
Job Details
NO C2C allowed. Local to MI candidates only. NO Sponsorship.
Job Description:
We are seeking a skilled Python Developer with experience in Azure and Spark to join our team. The ideal candidate will have a strong background in building and optimizing data pipelines, with an eye toward modernizing our streaming data architecture.
Core Skills:
Python development
Microsoft Azure
Apache Spark
Value-Add Skills:
Redis experience is highly desirable. While Redis is independent of Microsoft, it is highly relevant to our planned architecture.
Candidates with experience using Redis in an Azure environment are especially valuable.
Future Work and Direction:
Anticipated changes in data streaming will require reworking existing Python pipelines.
Transitioning from 15-minute batch processing to real-time data ingestion.
Future plans include pushing streaming data directly into a Redis cache to allow systems to access data on demand without waiting for batch cycles.
This initiative is part of a broader modernization effort and requires developers with experience in real-time data processing, cloud infrastructure, and caching solutions.
Qualifications:
Strong experience in Python and Spark development in cloud environments
Hands-on experience with Azure services
Experience with real-time data processing and caching technologies is a plus
Redis knowledge is highly recommended
Why Join Us:
Opportunity to work on cutting-edge cloud and data pipeline technologies
Be part of a modernization initiative impacting large-scale real-time systems
Collaborative team environment with room for innovation