Data Engineer

Must Haves: Data bricks is a must-have and lead experience is needed

• They need a Lead with hands-on data engineering experience, strong in Data bricks, Spark and SQL Cloud

Interview Process: Prescreening (one way video link)

• 3 video questions, these questions are specific questions given by the HM. Please coach candidates to reply with their own knowledge and experience and to NOT use Ai generated responses. Any candidates who appear to be reading responses will be rejected

Info Required at Submittal:

• LinkedIn Profile

• Last 4 of SSN

Our client, a leading organization in the industry, is seeking a Data Engineer Level 2 to join their team. As a Data Engineer Level 2, you will be part of the Data Solutions Department supporting the Data Engineering team. The ideal candidate will have strong problem-solving skills, attention to detail, and the ability to work independently and collaboratively within an agile environment, which will align successfully in the organization.

What''s the Job?

• Analyze, design, and develop enterprise data solutions utilizing Azure, Databricks, Spark, Python, and SQL.
• Develop, optimize, and maintain Spark/PySpark data pipelines, addressing performance issues such as data skew, partitioning, caching, and shuffles.
• Build and support Delta Lake tables and data models for analytical and operational use cases.
• Implement cloud infrastructure automation and CI/CD workflows using Terraform, GitHub, and GitHub Actions.
• Collaborate with engineering teams to enhance tools, systems, and data security, ensuring scalable and reliable data solutions.

What''s Needed?

• 5+ years of experience as a Data Engineer with hands-on expertise in Azure Databricks, Spark, and Python.
• Strong SQL and database background, with experience in Delta Live Tables (DLT) or Databricks SQL.
• Experience with Azure Functions, messaging services, or orchestration tools.
• Familiarity with data governance, lineage, or cataloging tools such as Purview or Unity Catalog.
• Proficiency with Terraform for cloud infrastructure provisioning and GitHub for version control and CI/CD automation.

• Opportunity to work on cutting-edge cloud data solutions in a collaborative environment.
• Engagement with a dynamic team of professionals committed to innovation and excellence.
• Potential for professional growth and skill development in modern data engineering practices.
• Competitive pay aligned with market standards.
• Work in a supportive environment that values diversity and inclusion.