Data Engineer

Pittsburgh, PA, US • Posted 2 days ago • Updated 2 days ago
Full Time
No Travel Required
On-site
100000 - 110000/yr
Company Branding Image
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Scala
  • HDFS
  • Apache Spark
  • Data Processing
  • Apache Hadoop
  • Apache Hive
  • SQL
  • Data Engineering
  • Streaming

Summary

Role Overview   We are seeking an experienced Senior Data Engineer with strong Scala development expertise to build and support large-scale data processing solutions. This role will focus on developing high-performance data pipelines and applications using Spark and the Hadoop ecosystem, supporting critical enterprise data platforms. The ideal candidate brings strong problem-solving skills, a deep understanding of distributed data processing, and an engineering mindset that considers the full lifecycle of code—from design and development through deployment, performance optimization, and long-term production stability.

KEY RESPONSIBILITIES * Design, develop, and maintain scalable data pipelines and distributed data processing applications using Scala and Spark. * Build and optimize large-scale batch and data processing frameworks within the Hadoop ecosystem. * Write efficient and maintainable Scala-based applications for enterprise data platforms. * Develop and maintain SQL-based queries and transformations for data processing and validation. * Collaborate with data architects, engineers, and business stakeholders to translate business requirements into scalable data solutions. * Ensure data pipeline performance, reliability, and stability in production environments. * Troubleshoot and resolve performance issues across distributed systems. * Contribute to best practices around data engineering, code quality, testing, and operational support. * Support production environments and continuously improve monitoring, resiliency, and stability of data systems.

REQUIRED QUALIFICATIONS * 8+ years of experience in data engineering or software development roles. * Strong Scala development experience (primary programming language). * Hands-on experience with Apache Spark for distributed data processing. * Experience working within the Hadoop ecosystem (HDFS, Hive, YARN, or related technologies). * Basic to intermediate SQL skills for querying and manipulating data. * Strong problem-solving and analytical skills. * Demonstrated ability to design solutions while considering the entire software lifecycle, including performance, monitoring, and production stability.

PREFERRED QUALIFICATIONS * Experience working in Corporate & Investment Banking (C&IB) environments. * Familiarity with large-scale enterprise data platforms handling high data volumes. * Experience with data pipeline optimization and performance tuning. * Exposure to modern data platforms, streaming frameworks, or cloud-based data services. * Experience working in Agile development environments.

 

About Techstra Solutions 
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information: 

Equal Employment Opportunity Statement

Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91115673
  • Position Id: 8915252
  • Posted 2 days ago

Company Info

About Techstra Solutions

Techstra Solutions helps companies achieve the business value of Digital and Talent Transformation. Our client-focused services include strategy, technology and innovation in the areas of Cloud, Data, Digital and Automation. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results.

Our services focus on three key areas:

  • Management Consulting: We are innovative in our approach to co-creating solutions with your team, with an eye towards the repeatability and sustainability of the change.
  • Technology Services: We champion technology as a key business driver. Our technology professionals strategize, design and build the best possible digital experience that achieves measurable, long lasting results across all parts of your business.
    • Cloud: A holistic approach that optimizes and accelerates cloud deployment and maturity. It considers the impact on people, processes, and technology in conjunction with a rigorous review of DevSecOps, infrastructure, finance, data, operations, and security in order to deliver business value. Expertise focusing on Cloud Operationalization and Application Migration (Lift &Shift, DR, Refactor). Read More
    • Data: Unlock actionable insights by building artificial intelligence and machine learning platforms that deliver value to customers. Core elements of success include data governance; data pipelines: movement, streaming, traceability, and transformation; data protection; reporting, analytics, and visualizations.
    • Digital: Consulting and development expertise applied to custom development and the integration of end-to-end digital web and mobile solutions. Transform, connect and enhance your digital experience with meaningful interactions both inside and outside of your organization. Our engineering expertise employs best practices in Cloud, Legacy Modernization, Digital Marketing and DevSecOps.
    • Automation: Transform and automate repetitive transactional business processes by combining the power of Robotic Process Automation (RPA) and cognitive capabilities such as AI/ML, NLP, and OCR technologies to streamline operation and drive business efficiencies.
  • Performance & Measurement: Our Techstra TPI™ platform predicts the probability of transformation success. It provides visibility into factors critical to achieving the expected outcomes and identifies high-risk factors for failure enabling leaders to make better decisions and proactively address potential issues earlier in the initiative.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs