Data Engineer

  • Columbia, MD
  • Posted 12 days ago | Updated moments ago

Overview

On Site
Contract - W2

Skills

Data Engineer

Job Details



1 DAY ONSITE PER WEEK IN COLUMBIA, MD - CANDIDATE MUST BE LOCAL


Job Title: Data Engineer
Reports To: Senior Data Engineer Technical Lead
Location: Columbia, MD (onsite 1 day/week)


Essential Duties & Responsibilities



  • Design, build and maintain large, complex data processing pipelines to meet business requirements

  • Develop automated quality controls; perform unit, integration and user acceptance testing

  • Create scalable, reusable frameworks for ingestion and transformation of large data sets

  • Troubleshoot pipeline issues and perform root cause analysis

  • Collaborate with source system and business owners to incorporate requirements into data pipelines

  • Document data workflows, processes and infrastructure comprehensively



Required Skills & Experience



  • Advanced programming in PySpark, Python and Spark SQL

  • Deep understanding of Data Lake architecture (raw, enriched and curated layers) and ETL in Azure

  • Proven experience building complex data pipelines for lakehouse/data warehouse environments using Agile methods

  • Hands on architecture, design and implementation experience with Databricks and Azure Data Factory



Education & Background



  • Bachelor's degree (4 year college)

  • Minimum 4 years' experience in data integration

  • At least 2 years of advanced PySpark programming

  • Databricks experience preferred



Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.


Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit to learn more.


Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Dexian DISYS