Job Descripton:
We are seeking a highly experienced Lead Software Engineer to design, develop, and optimize enterprise-scale applications and big data platforms. The ideal candidate will have strong expertise in Apache Spark, AWS Cloud, Full Stack Development, System Design, and Software Engineering best practices.
Required Skills:
7+ years of Software Engineering experience
Strong System Design and Architecture experience
Expertise in Apache Spark, Hadoop, Hive, and Trino
Experience processing large-scale datasets (TB/PB scale)
Advanced SQL (Window Functions, Joins, Aggregations, Query Optimization)
Strong programming skills in Python or Scala
AWS Services: S3, EMR, Glue, Athena, Lambda, EKS
Full Stack Development (Frontend, Backend, APIs, Microservices)
Object-Oriented Design and Design Patterns
Data Storage Technologies (Relational & NoSQL)
Performance Tuning and Optimization
DevOps, CI/CD, and Infrastructure Automation
Test Automation, Unit Testing, and Quality Engineering
Software Security and Secure Coding Practices
Experience with AI tools such as GitHub Copilot, ChatGPT, Claude, Amazon Q
Leadership Responsibilities:
Lead architecture and technical design initiatives
Mentor and guide engineering teams
Drive engineering excellence and best practices
Collaborate across business and technology teams
Lead modernization, automation, and AI adoption efforts
Preferred Skills:
Kubernetes / EKS
Serverless Architectures
Financial Services experience
Agile/Scrum leadership
Cloud Certifications (AWS)
Large-scale distributed systems experience
Qualifications:
Bachelor''s degree in Computer Science or related field
Strong communication and stakeholder management skills
Proven experience delivering enterprise-grade solutions