Spark/Big Data Developer


On Site
Full Time


Big data
Data processing
Machine Learning (ML)
Professional development
Life insurance
Business requirements
Operational efficiency
Advanced analytics
Data Science
Computer science
Analytical skill
Business analysis
Goal oriented
Critical thinking
Apache Spark
Software deployment

Job Details

Short Description for Internal Candidates
The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform. Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment
Description for Internal Candidates
Are you ready to make an impact at DTCC?

Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We're committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact.We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.

Pay and Benefits:

Competitive compensation, including base pay and annual incentive

Comprehensive health and life insurance and well-being benefits, based on location

Pension / Retirement benefits

Paid Time Off andPersonal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).

About this Opportunity

Your Primary Responsibilities:
  • Technical expertise with distributed Spark or other distributed data processing technologies
  • Work with large, complex data sets and high throughput data pipelines that meet business requirements.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Build data and analytics tools that utilize the data pipeline to provide actionable insights to operational efficiency and other key business performance metrics.
  • Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs.
  • Collaborate with data scientists and architects on several projects.
  • Solve various complex problems.
  • Designing processes to integrate data from multiple sources to facilitate client centric advanced analytics
  • Developing efficient, scalable and repeatable processes to transform data into insight on regular basis

Talent Needed for Success:
  • Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering
  • Previous experience as a data engineer or in a similar role
  • 5+ years of Python development experience is necessary.
  • Hands-on experience with database technologies (e.g. SQL and noSQL)
  • Experience building high throughput data pipelines.
  • Technical expertise with distributed Spark or other distributed data processing technologies
  • Experience with machine learning techniques
  • Great numerical and analytical skills
  • Ability to write reusable code components.
  • Open-minded to the new technologies, frameworks
  • Thorough business analysis skills

Additional Qualifications
  • Understanding Blockchain system mechanism
  • Knowledge of data preparation techniques to aid statistical analysis
  • Results-oriented self-starter who is confident in defending his/her critical thinking abilities

Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

About The Depository Trust & Clearing Corporation