Senior Data Platform Engineer - Elk Grove, CA (Hybrid ? 3 days a week on-site)

• Design, develop, and maintain robust data pipelines for ingesting, transforming, and storing large volumes of structured, semi-structured, and unstructured data.
• Implement data workflows and ETL processes using technologies such as Spark, Delta Lake, and cloud-native tools.
• Support the production use of big data platforms (e.g., Databricks, Snowflake, Google Cloud Platform), ensuring high availability, scalability, and performance.
• Monitor, troubleshoot, and resolve issues in production data systems, including job failures, performance bottlenecks, and data quality concerns.
• Collaborate with data architects to translate business requirements into technical solutions, ensuring alignment with architectural standards and best practices.
• Optimize SQL queries, Spark jobs, and data processing workloads for efficiency and cost-effectiveness.
• Implement and maintain data governance, security, and compliance measures, including access controls, data masking, and audit logging.
• Integrate data workflows into CI/CD pipelines, automate deployment processes, and manage source control using Git and related DevOps tools.
• Document data pipelines, workflows, and operational procedures to support knowledge sharing and maintainability.
• Stay current with emerging big data technologies and recommend improvements to enhance reliability, scalability, and efficiency.

• 7+ years of experience in data engineering or related roles, with hands-on experience building and supporting production data pipelines.
• Strong proficiency with big data platforms (e.g., Databricks, Snowflake, Google Cloud Platform) and the Spark ecosystem.
• Experience with data lakehouse and warehouse architectures, including Delta Lake or similar technologies.
• Senior Data Engineer with deep expertise in Retrieval-Augmented Generation (RAG) systems and advanced chunking strategies for optimizing semantic search and LLM integration, delivering scalable solutions for enterprise knowledge retrieval and contextual AI applications.
• Advanced skills in PySpark, Python, SQL, and related data processing frameworks.
• Experience with cloud storage, messaging/streaming technologies (e.g., Apache Kafka, cloud Pub/Sub), and vector databases.
• Proven ability to optimize ETL jobs, tune cluster configurations, and troubleshoot production issues.
• Familiarity with data governance tools, catalog solutions, and security best practices.
• Experience integrating data workflows into CI/CD pipelines and using DevOps tools (e.g., Git, Jenkins, Terraform).
• Strong problem-solving skills, attention to detail, and ability to work independently or as part of a team.
• Excellent communication skills to collaborate with cross-functional teams and document technical solutions.
• Experience working in an Agile environment.

• Big Data Platforms: Spark, Delta Lake, SQL engines, MLflow (or similar model tracking tools), relational databases.
• Data Governance: Data catalog and access control solutions.
• Programming & Data Processing: PySpark, Python, SQL.
• Cloud Services: Experience with cloud storage, messaging/streaming technologies, vector databases and BigQuery.
• DevOps & CI/CD: Git for version control, Jenkins, and infrastructure-as-code tools (e.g., Terraform) are a plus.
• Other Tools: Project and workflow management tools (e.g., JIRA, Confluence), BI/analytics tools (e.g., Power BI, Looker Studio).

• Certifications in major big data platforms (e.g., Databricks, Snowflake, Google Cloud Platform) are advantageous.
• Exposure to related big data and streaming tools such as Apache Kafka, cloud messaging services, Apache Airflow, and BI/analytics tools is a plus.
• Google Professional Cloud Architect or better - Preferred, but not required
• Azure Solutions Architect Expert - Preferred, but not required

• Strong technical skills
• Teamwork and collaboration
• Judgmental and decision making skills
• Excellent communication to technical and non-technical audience
• Leadership and creativity
• Striving for greater good of customers and enterprise
• Language & Technology MUSTS: Java/C#, Message Brokering, SQL/NoSQL, Angular/REACT
• Architecture and Patterns: SPA, Microservices, Event Driven, DDD

1. Puts Customers First
   • Provides WOW! Customer service every time, every where
   • Understands customer needs and solves their problem
   • Shows sense of urgency in correctly meeting customer needs
2. Team Player
   • Is a reliable and supportive team member
   • Values the ideas and opinions of others
   • Gives recognition for good work
   • Builds strong relationships with others
   • Resolves conflict effectively
   • Steps in and assumes leadership roles when needed
3. Communicates Effectively
   • Communicates in a clear, straightforward, respectful way
   • Demonstrates effective listening skills
   • Listens and assumes positive intent
4. Results the Right Way
   • Does what it takes to do the job right (WITTDTJR)
   • Is accountable, takes ownership and meets commitments
   • Prioritizes well, plans and executes in a manner of high integrity and ethics
5. Development Focused
   • Asks for and embraces feedback
   • Owns professional development
6. Embraces Change
   • Understands and is open to change
   • Looks for ways to improve our processes, services and products while maintaining our culture of thrift

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions Privacy Policy and INSPYR Solutions AI and Automated Employment Decision Tool Policy: . By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.