Overview
On Site
Full Time
Skills
Snowflake
DW
Datalake
Datawarehouse
Data Pipeline
Azure Data Lake
Job Details
Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CA
We are seeking a Senior Data Engineer to design and implement AI/ML-driven data solutions for enterprise cloud environments. You'll leverage modern data engineering, data warehousing, and data lake technologies on platforms like AWS, Azure, and Google Cloud Platform to optimize multi-cloud data workflows in a fast-paced, innovative setting.
Responsibilities
- Design and develop data pipelines, data lakes, and data warehouses using cloud platforms (AWS, Azure, Google Cloud Platform, Databricks) with a preference for Azure expertise.
- Experience with SQL, schema design, and dimensional data modeling to build scalable data solutions.
- Implement ETL/ELT processes using tools like Azure Data Factory (ADF), Informatica, Talend, and data warehousing technologies (Azure Synapse, Amazon Redshift, Snowflake, Google BigQuery).
- Utilize big data tools (Databricks, Spark) and programming skills in PySpark and Spark SQL to support AI/ML-driven data analytics.
- Collaborate with cross-functional teams to ensure data warehouse best practices, development standards, and methodologies are met.
Required Skills
- Minimum 5 years in modern data engineering, data warehousing, or data lake technologies on cloud platforms (AWS, Azure, Google Cloud Platform, Databricks)
- 10+ years with SQL, schema design, and dimensional data modeling.
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
- Hands-on experience with Azure (preferred), AWS, Google Cloud Platform, and Databricks for data solutions.
- Proficiency with ADF, Informatica, Talend, and technologies like Azure Synapse, Amazon Redshift, Snowflake, or Google Big Query.
- Strong experience with Databricks, Spark, PySpark, and Spark SQL for big data processing.
- Solid knowledge of data warehouse best practices, development standards, and Agile methodologies.
- Excellent communication, teamwork, and self-learning abilities in a fast-paced environment.
Preferred Skills
- Knowledge of Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Services, or Cosmos DB for advanced data streaming and storage.
- Experience with SAP ECC, S/4, or Hana for enterprise data integration.
- Intermediate proficiency in data visualization tools (e.g., Power BI) for actionable insights.
- Expertise in Azure DevOps, CI/CD deployments, and cloud migration methodologies.
- Proven track record of delivering scalable, AI/ML-enhanced data solutions in IT services environments.
We are an AI-first leader in full-stack product and platform engineering services. We leverage advanced technologies such as Data and Cloud Engineering integrated with AI to help our clients scale, innovate, transform their businesses in the digital age and realize business value with better customer experience.
Right Skale Inc, headquartered in Pleasanton, CA, is an emerging global product development and platform engineering company.
With a focus on digital transformation and cloud computing, we provide end-to-end technology solutions and services from strategy, architecture, and consulting to software development.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.