Overview
On Site
$80,000 - $120,000
Full Time
Skills
Data Architecture
Data Processing
MongoDB
NoSQL
Oracle
Microsoft Azure
PySpark
RDBMS
Python
Workflow
Extract
Transform
Load
Databricks
Job Details
Hi,
Title- Data Bricks dev with Python
Location- Plano, TX (Day1 Onsite)
Experience: 8-10 Years
Job Description
Responsibilities
- Design and implement scalable data processing solutions using Azure Databricks.
- Collaborate with data Scientist and analysts to understand data needs.
- Optimize data pipelines and workflows for performance and scalability.
- Ensure data quality and integrity throughout Data Transformation and Load processes.
- Develop and maintain data architecture and best practices.
- Troubleshoot and resolve data related issues in a timely manner.
- Setup Performance Monitoring and Alerting for pipeline and data integrity
- Proficient in ETL between different RDBMS like Oracle to Data Bricks and NoSQL Databases.
- Working knowledge in Python/Pyspark/ Scala.
- exp in mongo db is must to have
- Experience in MongoDB will be added advantage.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.