Overview
On Site
Depends on Experience
Full Time
Able to Provide Sponsorship
Skills
Databricks SME
Data Model skills
AI Agents
Job Details
Position Title: Databricks SME with Data Model skills & AI Agents expertise
Work location: Dallas, TX
Duration: 12 plus months contract with possible extensionJob Description:
Work location: Dallas, TX
Duration: 12 plus months contract with possible extensionJob Description:
- Need strong exp with Databricks SME with Data Profiling & Data Model Skills and AI agents
- A Data Engineer specializing in Databricks is responsible for designing, building, and maintaining scalable data pipelines and infrastructure to process and analyze large datasets efficiently. This role involves collaborating with cross-functional teams to ensure data accessibility, quality, and security within the Databricks environment.
- Design, develop, and implement scalable data pipelines using Databricks to ingest, transform, and store structured and unstructured data.
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Performance Optimization: Analyze, optimize, and tune existing data pipelines for performance, reliability, and efficiency.
- Implement security measures and best practices to ensure data privacy and compliance with regulatory standards.
- Work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure efficient data processing and analysis.
- Proven experience with Databricks and data infrastructure technologies, including Apache Spark, SQL, and Python.
- Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform, and their data services.
- Data Warehousing: Experience in designing and implementing data warehousing and ETL processes.
- Excellent problem-solving skills and attention to detail.
- Communication Skills: Strong communication skills and ability to work collaboratively with cross-functional teams.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.