Scalable Systems is a USA based Big Data, Analytics and Digital Transformation company focused on vertical specific innovative solutions. By providing next generation technology solutions and services, we help organizations to identify risks & opportunities, achieve operational excellence and to gain an innovative edge.Senior Data Engineer
Work location: 4 days/week at the client office in Midtown, Atlanta GA
Contract on W2
Note: Please submit local candidates only
Position Overview
We are seeking a Senior Data Engineer to join the core Symphony platform team in an onshore capacity. This is a hands-on development role focused on building, maintaining, and optimizing data pipelines and warehousing solutions. The engineer will work within a local-first development model and is expected to be a strong, independent contributor capable of owning complex workstreams.
Key Responsibilities
• Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
• Monitor and support Phase 1 pipelines post go-live
• Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
• Lead refactoring and cleanup of existing Phase 1 code
• Optimize existing solutions for performance and scalability
• Build and contribute to reusable patterns and automation frameworks
• Work within metadata-driven architecture
• Ensure pipelines are used strictly for scheduling — ETL logic must remain in code
• Manage code using GitHub version control
• Contribute to discovery sessions to derive requirements directly from data
Required Skills & Experience
Must Have:
• 8–10 years of hands-on data engineering experience
• Strong understanding of Apache Spark and its core concepts
• Proficiency in Scala and/or Java — code-first approach required
• Advanced SQL skills
• Experience with Azure Synapse
• Working knowledge of GitHub for source control
• Experience with data warehousing and large-scale data integration
Nice to Have:
• Experience with Microsoft Fabric
• Background in marketing data or consumer goods analytics
• Familiarity with metadata-driven architectures
Non-Negotiables:
Must be a hands-on builder
Must be available to mobilize immediately
Must commit to 4 days/week onshore
Scalable Systems is an Equal Opportunity-Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation