Data Engineer

  • Glen Allen, VA
  • Posted 2 days ago | Updated 3 hours ago

Overview

On Site
Full Time

Skills

Data Lake
Data Warehouse
Scalability
Parallel Computing
System Integration
Data Validation
Workflow
Documentation
Data Flow
Knowledge Sharing
Onboarding
Data Engineering
Python
Apache Spark
ADFS
Redis
Relational Databases
SQL
Microsoft SQL Server
Database
Slowly Changing Dimensions
SCD
Cloud Computing
Agile
Rapid Prototyping
Design Thinking
DevOps
Microsoft Azure
Databricks
Communication
Analytical Skill
Problem Solving
Conflict Resolution
Attention To Detail
Continuous Improvement
Management
Adaptability
Mentorship
IT Service Management
Innovation
Collaboration
Recruiting
Insurance
Finance
Professional Development
Training
Leadership
CompTIA
Customer Service
Career Counseling
Apex
Oracle Application Express

Job Details

Job#: 3009726

Job Description:

Data Engineer (Mid-Level)

Length: 6 month contract to hire

Location: Richmond, VA (Hybrid)

Job Summary

We are seeking a highly motivated Data Engineer to design and implement scalable, end-to-end data solutions within our Azure Data Lake and Data Warehouse environments. This role is responsible for engaging in close, cross-functional collaboration with Architecture, Infrastructure, and Business teams as well as management to align with enterprise-scale requirements and evolving organizational data strategies.

Key Responsibilities
  • Design, develop, test, document, and maintain moderately complex programs using industry standards and tools.
  • Optimize data pipelines and queries for performance, scalability, and cost-efficiency across large-scale datasets and distributed systems. Leverage parallel processing techniques to ensure high-throughput and low-latency data operations in Azure cloud environment.
  • Develop test specifications, conduct tests, diagnose faults, and produce system integration reports.
  • Apply data validation, cleansing, and monitoring techniques to ensure data accuracy, consistency, and reliability across systems.
  • Monitor data workflows, diagnose issues, and implement fixes to ensure uninterrupted data operations.
  • Participate in code reviews and collaborate with peers to ensure high-quality deliverables.
  • Follow directions from senior team members and contribute to a collaborative team environment.
  • Build and maintain clear documentation of data flows, architecture decisions, and operational procedures to support knowledge sharing and onboarding.
  • Continuously explore and evaluate new tools, frameworks, and best practices in data engineering and cloud computing.
  • Occasionally work evenings or weekends and travel as needed to meet business needs.


Requirements:
  • 2+ years of experience coding in Python, SQL, Spark, and Spark SQL
  • Proven experience with modern data tools such as Spark, ADFS, Databricks, Azure Data Factory, Redis, and Elastic
  • 2+ years of experience with relational databases and SQL development/tuning (MS SQL Server preferred)
  • Strong understanding of database concepts including Slowly Changing Dimensions (SCD)

Preferred Skills:
  • 2+ years of experience with Azure cloud-based applications
  • Experience with Agile methodologies and rapid prototyping
  • Familiarity with design thinking and customer-centric design
  • Experience with Azure DevOps and serverless tools (Logic Apps, Function Apps)
  • Azure or Databricks certifications


Skills & Competencies
  • Excellent verbal and written communication skills
  • Strong analytical and problem-solving abilities
  • Ability to work independently and as part of a team
  • Detail-oriented with a passion for continuous improvement
  • Demonstrated initiative and ability to manage complex assignments
  • Creative, innovative, and adaptable to change
  • Ability to lead and mentor while contributing as an individual contributor


Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.

Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Apex Systems