Data Architect

Job Title: Databricks Data Engineer
Location: On-Site (Multiple Offices Nationwide)
Employment Type: Full-Time
Salary Range: $165,000 - $185,000 per year + Annual Bonus

About the Role:
We are seeking a highly skilled Databricks Data Engineer to join our on-site team supporting clients across multiple office locations nationwide. The ideal candidate will have a strong background in designing, developing, and optimizing big data pipelines in Databricks, with solid experience across both Azure and AWS environments. Prior experience in the banking or financial services industry is highly preferred.

Key Responsibilities:
Design and implement scalable data pipelines using Databricks, Spark, and Delta Lake.

Develop robust ETL/ELT solutions for structured and unstructured data.

Collaborate with data scientists, analysts, and other engineers to support advanced analytics and machine learning use cases.

Optimize data workflows for performance and cost efficiency across cloud platforms.

Maintain data quality and security standards aligned with industry best practices and regulatory requirements.

Work with cross-functional teams to translate business requirements into technical solutions.

Develop and maintain documentation for data processes, architecture, and workflows.

Requirements:
5+ years of experience in data engineering, with at least 2 years of hands-on experience with Databricks.

Proficient in Apache Spark, SQL, and Python.

Experience working with Azure Data Services (e.g., Azure Data Lake, Azure Synapse, Azure Data Factory).

Experience with AWS services such as S3, Glue, Redshift, or EMR.

Strong understanding of data warehousing, data lakes, and data modeling principles.

Previous experience in the banking or financial services industry, with a clear understanding of data privacy, compliance, and governance frameworks.

Familiarity with DevOps practices and CI/CD pipelines for data engineering projects.

Excellent problem-solving and communication skills.

Nice to Have:
Experience with tools like Terraform, DBT, Airflow.

Knowledge of financial risk, fraud detection, or regulatory reporting.

Certifications in Azure, AWS, or Databricks.

What We Offer:
Competitive salary between $165,000 and $185,000, based on experience.

Annual performance-based bonus.

Opportunities to work in a dynamic and fast-paced environment.

On-site collaboration across various client offices nationwide.

Continuous learning and professional development.

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.