Senior Engineer, Data Platform Technology

• Posted 3 days ago • Updated 11 hours ago
Full Time
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Decision-making
  • Attention To Detail
  • Collaboration
  • Data Acquisition
  • Artificial Intelligence
  • Workflow
  • Onboarding
  • Meta-data Management
  • Natural Language
  • Data Quality
  • Computer Science
  • Analytical Skill
  • Python
  • SQL
  • NoSQL
  • Snow Flake Schema
  • Analytics
  • Data Warehouse
  • Apache Spark
  • Apache Hive
  • Apache Hadoop
  • Apache Oozie
  • Apache NiFi
  • Cloud Computing
  • Amazon Web Services
  • Microsoft Azure
  • Google Cloud
  • Google Cloud Platform
  • Time Series
  • Communication
  • Finance

Summary

Role Overview

We are looking for a creative and enthusiastic Data Engineer to join our team. In this role, you will help build and maintain scalable data platforms and pipelines that power analytics, applications, and decision-making across the organization. You will work with a wide range of structured and unstructured datasets, design reliable data models, and develop services that make data accessible and useful to end users.

The ideal candidate has experience building and supporting modern data infrastructure, working with large-scale datasets, and creating high-quality, analytics-ready data products. This role requires strong technical skills, attention to detail, and the ability to collaborate closely with both technical and business stakeholders.

In this role, you will:
Develop cloud-first data ingestion processes using Python, SQL, and Spark
Engineer data models and infrastructure for a wide variety of market and alternative datasets
Design and build services and plugins to enhance our Data Acquisition Platform
Maintain alerting systems to ensure smooth day-to-day operations for hundreds of datasets
Author tests to validate data quality and the stability of the platform
Build and support AI-enabled workflows that accelerate dataset onboarding, pipeline creation, metadata generation, and natural-language access to data
Design and evolve rules-based data quality frameworks that automatically validate completeness, freshness, schema integrity, and business logic across datasets
Investigate and defuse time-sensitive data incidents
Communicate with data providers to onboard new datasets and troubleshoot technical issues
Evangelize best practices to partners throughout the firm
Work directly with Analysts, Quants, and Portfolio Managers to understand requirements and provide end-to-end data solutions

What You'll Bring
Bachelor's or Master's degree in Computer Science or a related field
Strong analytical, data, and programming skills (Python, SQL, NoSQL)
Strong experience with Snowflake and building analytics-ready datasets in a modern cloud data warehouse
3+ years of experience with at least one of Spark, Hive, or Hadoop
2+ years of experience orchestrating pipelines with technologies such as Airflow, Luigi, Oozie, or NiFi
1+ years of experience with cloud technologies (AWS, Azure, or Google Cloud)
Solid understanding of time series data and temporal queries
Experience with large datasets and techniques to architect them for performance
Ability to understand and contribute to existing data systems software
Strong oral and written communication skills; must be a team player

Nice to Have
Experience with Go
Aptitude for designing infrastructure, data products, and tools for Data Scientists
Financial industry experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10125634
  • Position Id: ecd8071e6d25d77bdd4cfc28925b5d11
  • Posted 3 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

New York, New York

Today

Full-time

New York, New York

Today

Full-time

USD 150,000.00 - 225,000.00 per year

New York, New York

Today

Easy Apply

Full-time

USD 75.00 - 85.00 per hour

New York, New York

Today

Full-time

USD 135,000.00 - 180,000.00 per year

Search all similar jobs