Senior Data Engineer

• Posted 5 hours ago • Updated 5 hours ago
Full Time
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Research
  • Collaboration
  • Analytics
  • Software Development
  • Python
  • Relational Databases
  • Data Storage
  • Data Quality
  • Data Governance
  • Auditing
  • Microsoft Certified Professional
  • Artificial Intelligence
  • Agile
  • Communication
  • Finance
  • Financial Services
  • Databricks
  • Apache Spark
  • Data Engineering
  • Analytical Skill
  • Data Integration
  • Data Processing
  • Provisioning
  • Management
  • Amazon SQS
  • Cloud Computing
  • Cloud Architecture
  • Amazon Web Services
  • Terraform
  • English

Summary

Project description

Build data pipelines and data products to enhance investment research capabilities for a top US & global investment firm.

Responsibilities

Collaborate closely with business stakeholders, product managers, and engineering teams to translate business objectives into technical solutions.

Design, build, and enhance data pipelines and integration frameworks supporting AI, analytics, and business applications.

Improve data quality, reliability, lineage, and monitoring.

Integrate data solutions with the organization's AI infrastructure (AWS based) and tools with security in mind.

Implement AI first approach: use AI agents as a primary tool to design, build, test, and support solutions

Skills

Must have

10+ years of professional software development, including 5+ years of data engineering experience.

Advanced proficiency in Python, including experience building scalable backend services and data processing solutions.

Strong hands-on experience designing and implementing data pipelines, data integration solutions, with a latency and cost in mind

Experience working with relational databases and modern data storage technologies, including graph, vector, or analytical data platforms.

Experience with data quality and data governance approaches, including validations in the pipeline, entitlements, audit, and lineage

Experience working with MCP Gateway, including the security aspect.

Experience working with cloud platform to host AI solutions, such as Amazon Bedrock AgentCore.

Experience operating in agile delivery environments.

Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Experience working with financial domain users, especially investment business, is a big plus.

Nice to have

Financial services, especially investment domain.

Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms.

Experience with dbt.

Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms.

Experience with Aurora, Neptune, and other AWS data services.

Strong hands-on experience designing and implementing data pipelines, data integration solutions, and large-scale data processing architectures.

Experience architecting, provisioning, and managing production infrastructure on AWS, including services such as ECS Fargate, Lambda, SQS, and related cloud-native technologies.

Experience defining cloud architecture programmatically using Infrastructure-as-Code (IaC) tools such as AWS CDK or Terraform.

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10335530
  • Position Id: 23831da14c256929a1aff6b20c325cfc
  • Posted 5 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.