Data Platform Engineer

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Platform Engineer for a contract assignment with one of our premier SaaS clients in San Jose, CA.

Responsibilities:

• Setup and maintain production-scale Databricks environments on public cloud platforms such as Microsoft Azure and AWS
• Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform
• Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services
• Maintain enterprise-scale SQL Server and SSAS environments
• Provide triage and mentorship to the team on various support issues raised by our tenants
• Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting
• Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake
• Explore GenAI technologies to integrate technical improvements and improve user experience
• Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product

Required Skills:

• BS or equivalent experience in Computer Science, Computer Engineering, or a similar field
• Cloud Infrastructure Administration and Automation:
  • AWS
  • Azure
• Proficiency in Storage Technologies:
  • ADLS Gen2
  • S3
  • MongoDB
  • Vector Databases
• AI Agent Development and Maintenance:
  • Langchain
• Setup and Operation:
  • Databricks
  • SQL Server & SSAS
  • Airflow
  • Azure Kubernetes Service or Elastic Kubernetes Service
• Monitoring and Alerting:
  • DBX System Tables
  • Prometheus
  • Splunk
  • MLFlow
• Maintenance:
  • Linux Servers
  • Kubernetes Environment
• Operational Tools:
  • Jira
  • Service Now

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.

#L1-RM1