Scala Data Engineer

Deerfield, IL, US • Posted 1 day ago • Updated 1 day ago
Full Time
No Travel Required
On-site
90000 - 100000/yr
Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

  • Scala
  • Databricks
  • spark

Summary

  • Mandatory skills: Databricks, Spark, Azure, Python, Cosmos DB, Azure DevOps (GitHub, CI/CD pipelines, Boards etc.), Docker & Azure Kubernetes Service, Graffana, JUnit, Postman, SonarQube
  • Additional Skills:  3–6 years of experience in data engineering on cloud data platforms. Hands‑on experience building Spark jobs with Scala/Spark and/or PySpark on Databricks. Experience ingesting data from batch and streaming sources into ADLS Gen2 using Delta or Apache Iceberg tables. Good SQL skills for joins, aggregations, and data quality checks. Understanding of core Azure data services (Event Hubs/Kafka, Data Factory/Databricks Workflows, Key Vault). Experience working with Git‑based workflows and CI/CD in Azure DevOps or GitHub.
  • Good to have skills: Exposure to Spark Structured Streaming for near real‑time use cases. Experience with data quality tools or frameworks and writing unit/integration tests for data pipelines. Familiarity with data modeling and performance considerations in Lakehouse environments.

Roles & Responsibilities:

  • Responsible for building data products in Databricks using Scala/Spark
  • Responsible for Ops work managing production for the data products developed and deployed to production
  • Responsible for testing data products based on product specification and end to end validation
  • Set up monitoring, logging, and alerting Spark jobs and data pipelines using Azure Monitor/Log Analytics or similar tools
  • Coordinate with offshore team in India
TCS Employee Benefits Summary:
 
  • Discretionary Annual Incentive.
  • Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
  • Family Support: Maternal & Parental Leaves.
  • Insurance Options: Auto & Home Insurance, Identity Theft Protection.
  • Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
  • Time Off: Vacation, Time Off, Sick Leave & Holidays.
  • Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
 
Salary Range-$90,000-$100,000 a year
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172467
  • Position Id: 8934549
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Deerfield, Illinois

Today

Easy Apply

Full-time

$100,000 - $140,000

Lake Forest, Illinois

23d ago

Full-time

USD 130,707.00 - 156,400.00 per year

Lake Forest, Illinois

23d ago

Full-time

USD 110,500.00 - 184,100.00 per year

Hybrid in Northbrook, Illinois

Today

Full-time

USD 134,000.00 - 201,000.00 per year

Search all similar jobs