Senior Data Engineer

Richmond, VA, US • Posted 12 hours ago • Updated 47 minutes ago
Full Time
On-site
USD $70.00 - 80.00 per hour
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Team Building
  • Analytics
  • Use Cases
  • Migration
  • Documentation
  • Production Support
  • Root Cause Analysis
  • Data Engineering
  • Software Engineering
  • Apache Spark
  • Scripting
  • Performance Tuning
  • Data Validation
  • Extract
  • Transform
  • Load
  • Version Control
  • Git
  • Continuous Integration
  • Continuous Delivery
  • Computer Cluster Management
  • Workflow
  • Orchestration
  • Step-Functions
  • Amazon Web Services
  • Amazon S3
  • Amazon Redshift
  • Mentorship
  • Technical Drafting
  • Financial Services
  • Scala
  • Electronic Health Record (EHR)
  • Python
  • SQL
  • Databricks
  • FOCUS
  • Problem Solving
  • Conflict Resolution
  • Information Technology
  • Privacy
  • Finance
  • Credit Cards
  • Banking
  • Onboarding
  • Payroll
  • Training
  • Reporting
  • Recruiting
  • Artificial Intelligence

Summary

Job Title: Senior Data Engineer
Location: Richmond / Mclean, VA
Duration: 06+ Months Contract with Extension

Job Description:
  • Senior Data Engineer - ETL/Scala
  • Experience: 8 plus years in data engineering
Role Summary:
  • Client is looking for an experienced data engineer to join client's team building and maintaining largescale ETL pipelines on AWS EMR, primarily in Scala.
  • This candidate will operate independently on complex, ambiguous problems, contribute to engineering standards across the team, and be equally comfortable in Python and SQL when the job calls for it.
  • Familiarity with Databricks is a strong plus as we continue to evolve client's data platform.
What Candidates Will Do:
  • Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability.
  • Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job.
  • Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases.
  • Work with Databricks notebooks/jobs as client's data platform usage grows, contributing to migration and modernization efforts where relevant.
  • Operate with autonomy on tasks with limited detail - scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight.
  • Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil.
  • Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation.
  • Participate in production support - troubleshoot pipeline failures, perform rootcause analysis, and implement fixes that avoid technical debt.
  • Communicate progress, risks, and blockers proactively to the team and stakeholders.
Required Qualifications:
  • 8 plus years of professional experience in data engineering or related software engineering roles.
  • Strong handson experience with Scala and Apache Spark, specifically on AWS EMR.
  • Working proficiency in Python for scripting, tooling, or pipeline components.
  • Strong SQL skills - complex queries, performance tuning, and data validation.
  • Demonstrated experience owning ETL pipelines endto-end: design, build, test, deploy, monitor.
  • Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution.
  • Experience with version control (Git), CI/CD practices, and productiongrade engineering hygiene.
Preferred Qualifications:
  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions.
  • Background in financial services or another regulated industry.
Core Competencies (aligned to Principal Associate expectations):
  • Technically Skilled & Versatile: Builds breadth across the stack (Scala/EMR as primary, Python/SQL/Databricks as needed); quickly ramps on new tools.
  • Independent / Manages Ambiguity: Operates with minimal guidance, scopes ambiguous problems, and drives them to resolution.
  • Automation Focused: Actively looks for ways to simplify, automate, and reduce repeated manual work.
  • Results Focus: Delivers quality work on committed timelines, owns outcomes beyond initial delivery.
  • Problem Solving: Explores multiple design options (e.g., build vs. reuse) before committing to a solution; avoids accruing technical debt.
About PTR Global: PTR Global is a leading provider of information technology and workforce solutions. PTR Global has become one of the largest providers in its industry, with over 5000 professionals providing services across the U.S. and Canada. For more information visit ;br>
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:

Pay any fee to be considered for, submitted to, or selected for any opportunity.
Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.

Pay Range: $70- $80/hr

The specific compensation for this position will be determined by several factors, including the scope, complexity, and location of the role, as well as the cost of labor in the market; the skills, education, training, credentials, and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits, including medical, dental, vision, and 401K contributions, as well as PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.

If you receive a suspicious message, email, or phone call claiming to be from PTR Global do not respond or click on any links. Instead, contact us directly at +1 . To report any concerns, please email us at

During the hiring process, we may use artificial intelligence (AI) tools to assist in evaluating information related to your application. These tools may help analyze job-related qualifications or assist recruiters in reviewing applications and interview responses. AI-generated information is one factor considered in our hiring process. Final employment decisions are made by qualified hiring personnel and are not based solely on AI-generated recommendations.

#LI-HY1
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: ptrtx
  • Position Id: 181450
  • Posted 12 hours ago

Company Info

About PTR Global

Pinnacle Group is a leading provider of information technology and workforce solutions. Pinnacle Group includes Pinnacle Technical Resources, Inc., its flagship information technology staffing and consulting services provider; Pinnacle MSP, a managed services provider; Pinnacle Payrolling, a payrolling and independent contractor compliance provider; Pinnacle Canada, which provides staffing, MSP and payrolling services in Canada.

About_Company_One
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.