Role: Senior Data Engineer - Spark/Scala
Location: Atlanta, GA, USA (ONSITE)
Duration: Contractual
Experience Req: 4+ Years
JD:
What You Will Do
Data Engineers build, optimize, and maintain the Symphony platform’s data pipelines, models, and integrations using Spark/Scala in a local first development environment.
Key Responsibilities
• Develop and maintain Spark/Scala data pipelines for marketing data integration.
• Implement metadata driven transformations and reusable engineering patterns.
• Perform refactoring and cleanup of Phase 1 codebase.
• Optimize performance, scalability, and reliability of data workflows.
• Conduct root cause analysis and resolve production issues.
• Implement automation and CI/CD best practices.
• Collaborate with Business Analysts to translate data driven requirements.
• Ensure no ETL logic is embedded in pipelines — pipelines used strictly for scheduling.
Must have Skills
• 4–7+ years in data engineering.
• Strong Spark/Scala development experience.
• Hands on experience with Azure Synapse; familiarity with Fabric is a plus.
• Strong SQL, data modeling, and warehousing skills.
• Experience with metadata driven or parameterized frameworks.
• Ability to work independently in a discovery driven environment.
Nice to Have Skills
• Marketing data domain knowledge.
• Experience with automation first engineering cultures.