About the Role
We are hiring an Senior Apache Spark Developer
Required Qualifications
- 5+ years of hands-on development experience with Apache Spark.
- Strong expertise in:
- Spark SQL
- Structured Streaming
- DataFrames/Datasets
- Performance tuning and optimization
- Experience integrating Spark with Apache Kafka.
- Strong development skills in:
- Experience designing and supporting large-scale distributed systems.
- Solid understanding of software engineering principles, object-oriented design, and testing practices.
- Experience working with relational and distributed data platforms.
- Bachelor s Degree
Key Responsibilities
- Design, develop, and optimize Spark-based applications for large-scale data processing.
- Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
- Develop reusable frameworks and components supporting enterprise data engineering initiatives.
- Support migration efforts from on-premises data platforms to Databricks and AWS.
- Collaborate with architects and platform engineers to implement cloud-native data solutions.
- Optimize Spark jobs for performance, scalability, reliability, and operational efficiency.
- Participate in system design, code reviews, testing, and production support activities.
- Implement CI/CD, monitoring, and observability practices for distributed data applications.
- Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.
Preferred Qualifications
- Databricks experience (SQL).
- AWS experience, including services such as:
- Experience supporting large-scale cloud migration initiatives.
- Experience with lakehouse architectures and modern data platform patterns.
- Experience handling multi-terabyte or petabyte-scale datasets.
- Financial services or regulated industry experience.
Hourly Rate: 60$-65$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.
Benefits:
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)
About Us
At Collabera, we don t just offer jobs we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.
Ready to Apply?
Apply now or reach out to Pritam Palai at for more information. We look forward to speaking with you!
Never miss an opportunity! Create an alert based on the job you applied for.
