Data Engineer – Databricks / Scala
Cyma Systems Inc
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Apache HTTP Server
- Apache Spark
- Big Data
- Cloud Computing
- Data Engineering
- Data Processing
- Databricks
- Debugging
- DevOps
- Docker
- ELT
- Evaluation
- Extract, Transform, Load
- FOCUS
- Java
- Kubernetes
- Scala
- Microsoft Azure
- Mergers and Acquisitions
Summary
Data Engineer – Databricks / Scala (LOCALS ONLY : Quincy, MA )
Experience: 8–10 Years
Work Location: Quincy, MA – 100% Onsite
Candidate Preference: Local Candidates Only
Interview Requirement: Must be available for an in-person evaluation at Quincy or Princeton, NJ.
NEED ON W2
Must-Have Skills:
8+ years of Data Engineering experience.
Strong hands-on expertise in Azure Databricks, Scala and Apache Spark.
Scala / PySpark development and performance tuning.
Advanced SQL, ETL/ELT and data pipeline development.
Spark DataFrames, Datasets and Notebooks.
Large-scale data processing, streaming and transformations.
Delta Lake, Unity Catalog and Auto Loader.
Lakehouse and Medallion Architecture.
Spark Structured Streaming.
Databricks clusters, sizing, serverless and job orchestration.
Azure, DevOps pipelines and AKS troubleshooting.
Production monitoring, debugging and performance optimization.
Nice-to-Have Skills:
Apache Big Data ecosystem experience.
Java or R programming.
Docker and Kubernetes.
Containerization and cloud-native deployments.
Key Responsibilities:
Design and develop scalable Databricks data engineering solutions.
Build and optimize batch and streaming data pipelines.
Implement data ingestion, transformation and Lakehouse solutions.
Troubleshoot production Databricks jobs and DevOps pipelines.
Optimize Spark workloads and ensure data processing performance.
Key Focus: Azure Databricks | Scala | Apache Spark | PySpark | Delta Lake | Unity Catalog | Structured Streaming | SQL
- Dice Id: RTL327349
- Position Id: 9141527
- Posted 1 hour ago
Company Info
Cyma Systems is a technology solutions firm based in Connecticut serving mid-sized and Fortune 1000 businesses. We work with a range of corporate commercial clients as well as with the government sector. As a full-service consulting firm, we engage with our clients to share ideas on how we can help their businesses to become more profitable, to get a jump start on competitors by bringing products to market quickly, reducing costs, maximizing the use of existing technologies, driving more sales through the channel, and to bring additional value by forming a mutually beneficial partnership.
We think that the essence of a successful business is its ability to adapt and transform keeping ground realities in sight. At Cyma we work on leveraging the right synergies between technology and people that work towards transforming the outlook and results of your business.
