Looking for Data Support Engineer (Databricks experience)_Need only local to Chicago, IL
Vrddhi Solutions LLC
Dice Job Match Score™
👤 Reviewing your profile...
Job Details
Skills
- Analytical Skill
- Apache Airflow
- Apache Spark
- Application Support
- Cloud Computing
- Collaboration
- Conflict Resolution
- Continuous Delivery
- Continuous Integration
- Data Analysis
- Data Engineering
- Data Governance
- Data Lake
- Data Link Layer
- Data Processing
- Data Quality
- Data Storage
- Git
- Orchestration
- Network Layer
- Productivity
- Performance Tuning
- SQL
- Storage
- Problem Management
- Problem Solving
- Extract, Transform, Load
- Databricks
- DevOps
- Python
- ELT
- Streaming
- Documentation
- Microsoft Azure
- Unity
- Version Control
- PySpark
- Management
- Workflow
Summary
Position: Data Support Engineer (Databricks experience)
Location: onsite 3-4 days a week, Chicago, IL
Only locals required – No Relocation
Any Visa
Job Description:
A Data Application Support role specializing in Databricks focuses on maintaining, troubleshooting, and optimizing Spark-based data pipelines and Lakehouse architectures. Key responsibilities include resolving L2/L3 production incidents, performance tuning SQL/Python (PySpark) jobs, managing Delta Lake assets, and collaborating with data engineers to ensure data reliability.
Key Responsibilities
- Incident & Problem Management: Provide L2/L3 support for data applications, resolving production issues and troubleshooting Databricks jobs, notebooks, and workflows.
- Performance Tuning: Optimize Spark applications, SQL queries, and Delta Lake tables to improve efficiency and reduce costs.
- Pipeline Maintenance: Monitor and troubleshoot ETL/ELT pipelines in Databricks (including Data Factory/Delta Live Tables), ensuring data quality and lineage (Unity Catalog).
- Collaboration: Act as a liaison between users, data engineering teams, and platform engineering, providing technical expertise and contributing to documentation.
- Automation: Create tools to automate routine support tasks and enhance support team productivity. Databricks +5
Required Qualifications & Skills
- Technical Expertise: Strong hands-on experience with Apache Spark, Python/PySpark, and SQL.
- Databricks Ecosystem: Proficiency with Databricks Unified Data Analytics Platform, Delta Lake, and ideally Azure Databricks.
- Cloud Data Storage: Experience with Azure Data Lake Storage (ADLS Gen2) or similar data lake technologies.
- Version Control & CI/CD: Experience with Git/Azure DevOps for code management.
- Problem-Solving: Strong analytical skills, with the ability to diagnose complex data processing bottlenecks.
"Nice-to-Have" Skills
- Data orchestration tools (e.g., Apache Airflow, Azure Data Factory).
- Data governance tools (e.g., Unity Catalog, Collibra).
- Streaming data knowledge (e.g., Spark Structured Streaming).
- Dice Id: 91138338
- Position Id: 8945901
- Posted 1 day ago
Company Info
About Vrddhi Solutions LLC
Our clients trust us for what we do. We use our skills and industry experience to recruit, consult with and retain the best technology talent who will be the right fit for our clients, instead of simply filling an open position.
Vrddhi Solutions LLC helps skilled technology professionals connect with direct hire and contract positions in the areas of their expertise. Our clients utilize our services so they can focus on their business goals. We take on the responsibility of sourcing, screening, and hiring a most suitable candidate for our esteemed clients.
Vrddhi Solutions was established and firmly rooted beyond traditional staffing and consulting services – we believe in relationships. We are invested in you. And that means diving deep – understanding both your current and potential longer-term gaps and needs – and bringing the very best technical talent and cultural fit for those specific objectives.
We strive to provide experience-driven staffing solutions and managed services models that allow you to retain resources and knowledge
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs