Data Engineer

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a contract assignment with one of our premier SaaS clients in San Jose, CA . This is a hybrid role.

We are seeking a highly skilled Senior Data Engineer to join our Data Science Engineering team. In this role, you will design and maintain scalable data pipelines, orchestrate workflows, and develop dashboards that empower data-driven decision-making.

Responsibilities :

• Design, build, and maintain robust data pipelines to support analytics and dashboarding needs.
• Collaborate with stakeholders to gather business requirements and translate them into actionable data solutions.
• Develop modular and efficient ETL workflows using orchestration tools.
• Ensure comprehensive documentation for maintainability and knowledge sharing.
• Build and deploy cloud-native applications (AWS, Azure, or Google Cloud Platform) with a focus on cost optimization.
• Write scalable, distributed data processing code using PySpark, Python, and SQL.
• Integrate with RESTful APIs to consume and process external data services.
• Create high-performance dashboards using Tableau or Power BI.

Skills :

• 10+ years of experience in building scalable data pipelines and analytical dashboards.
• Proficiency in SQL, PySpark, and Python for Big Data processing.
• Strong experience with cloud platforms and data warehousing technologies (e.g., Databricks).
• Expertise in workflow orchestration tools (e.g., Airflow, AWS Glue).
• Experience designing architectures for complex workflows, including data privacy and deletion.
• Proven ability to reduce technical debt and automate data workflows.
• Deep understanding of data privacy, governance, and compliance.
• Experience handling petabyte-scale datasets.
• Familiarity with anomaly detection, monitoring, and alerting systems.
• Strong documentation and presentation skills.
• Skilled in performance tuning for dashboards and queries.
• Knowledge of Medallion Architecture and Delta Live Tables.
• Demonstrated ability to quickly adapt to new technologies and environments.
• Self-starter with a proven track record of delivering high-quality solutions with minimal ramp-up time.
• Strong problem-solving skills and a proactive mindset.

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.