Stellent IT LLC
Stellent IT LLC

Databrick Engineer

Malvern, PA, US • Posted 11 hours ago • Updated 1 minute ago
Full Time
Part Time
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • CaliberRM
  • Data Analysis
  • Pivotal
  • Data Extraction
  • Production Support
  • Reliability Engineering
  • Electronic Health Record (EHR)
  • Finance
  • Reporting
  • Computer Science
  • Information Systems
  • Data Engineering
  • Python
  • SQL
  • Apache Spark
  • PySpark
  • Databricks
  • Amazon S3
  • Step-Functions
  • Extract
  • Transform
  • Load
  • ELT
  • Data Processing
  • Cloud Computing
  • Dimensional Modeling
  • Continuous Integration
  • Continuous Delivery
  • Git
  • GitHub
  • Terraform
  • Agile
  • Scrum
  • Communication
  • Stakeholder Management
  • Financial Services
  • Asset Management
  • Apache HTTP Server
  • Apache Kafka
  • Amazon Kinesis
  • Streaming
  • Artificial Intelligence
  • Machine Learning (ML)
  • Advanced Analytics
  • Amazon Web Services

Summary

Hello

Databrick Engineer


Malvern, Pennsylvania Full Onsite


Proper LinkedIn with no single word update on resume

onsite interview required in Malvern, PA

Role Overview

*** Candidates must have real hands-on experience building ETL pipeline using Databricks***

We are seeking high-caliber Data Engineers to drive data analysis projects, Migrate jobs from EMR to Databricks, create strong job aids and train analysts. In this pivotal role, you will implement and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems.

Key Responsibilities & Outcomes

  • Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
  • Migrate jobs from EMR to Databricks.
  • Create strong job aids and train analysts.
  • Implement and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering core financial engines and reporting ecosystems.

Qualifications & Requirements

Required:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
  • 5-7+ years of enterprise Data Engineering experience.
  • Strong Python development experience.
  • Advanced SQL programming skills.
  • Extensive experience with Apache Spark and PySpark.
  • Strong experience with Databricks application.
  • Hands-on experience with AWS data services including: S3, AWS Glue, Athena, Lambda, Step Functions, EventBridge.
  • Experience building enterprise ETL and ELT pipelines.
  • Strong understanding of distributed data processing.
  • Experience working with large-scale cloud data platforms.
  • Strong knowledge of dimensional data modeling.
  • Experience implementing CI/CD pipelines (Git and GitHub Actions is mandatory, along with CloudFormation/Terraform).
  • Familiarity with Agile/Scrum methodologies.
  • Excellent communication and stakeholder management skills.

Preferred:

  • Financial Services or Asset Management industry experience.
  • Knowledge of Apache Iceberg, Delta Lake, or Hudi.
  • Experience with Airflow.
  • Knowledge of Kafka or Kinesis streaming.
  • Experience supporting AI/ML and advanced analytics platforms.
  • AWS Professional or Specialty Certifications.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91022079
  • Position Id: 2026-52403
  • Posted 11 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at Stellent IT LLC in Malvern, PA