Databricks Data Engineer

Hybrid in Gaithersburg, MD, US • Posted 2 days ago • Updated 7 hours ago

Contract Corp To Corp

Contract W2

Contract Independent

Hybrid

$62/hr

System One

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Summary

Job Title: Databricks Data Engineer
Location: This role is remote for candidates located within the United States; however, the ideal candidate will be based in or willing to relocate to the Washington, DC or Indianapolis, IN area to support periodic on-site activities.
Type: Contract
Security Clearance: Per government contract, must be US citizen to obtain a public trust.

System One is seeking a Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics platform. You will support continued maintenance of ETL operations and development of new pipelines ensuring data quality and data management. The ideal candidate will bring deep expertise in Databricks, a solid foundation in advanced AI technologies, and applies critical thinking to create innovative functions and solve technical issues by cross-functional team collaboration.

In this role, you will:

Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture.
Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple Databricks workspaces.
Integrate data from various structured and unstructured sources to enable high-quality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
Implement effective data management strategies to ensure data integrity, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
Collaborate with the team to enable advanced AI-driven analytics and data science workflows.
Integrate with various Azure services including Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management for seamless data workflows.
Experience with the above Azure services is a plus.
Provision and manage infrastructure using Infrastructure-as-Code (IaC)
Apply best practices for data security, data governance, and compliance, ensuring support for federal regulations and public trust standards.
Proactively collaborate with technical and non-technical teams to gather requirements and translate business needs into data solutions.

Required Skills:

BS degree in Computer Science or related field and 3+ years or Master’s degree with 2+ years of experience
3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams.
Proficient at Python, Spark and R are essential. .NET based development is a plus.
Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security.
Experience with Agile process methodology, CI/CD automation, and cloud-based developments (Azure, AWS).
Certifications in Azure cloud, Knowledge of FinOps principles and cost management to be considered
Not required, but additional education, certifications, and/or experience are a plus:

System One, and its subsidiaries including Joulé, ALTA IT Services, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.

#M1
#LI-CS1
#DI-CS1

Ref: #851-Rockville-S1

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10295162
Position Id: 345419
Posted 2 days ago

Company Info

About System One

System One is a leading provider of specialized, highly technical outsourced services, workforce solutions, staffing, and recruiting to critical infrastructure, technology, life sciences, and government sectors As an essential partner to private and public organizations of various needs and sizes, we offer our expertise to help them bring their most complex and mission-critical programs to fruition.

With our highly specialized services, in-demand technical skills, and vast operational expertise, we can deliver accelerated results that benefit our clients and the job seekers who partner with us. We staff contract, contract-to-hire, and direct-hire professionals across our network to work with our clients, some of whom are industry leaders and nationally branded organizations.

Our dedicated team of recruiters work tirelessly to match jobseekers with careers that align with their skills, aspirations, and goals.

We understand that finding the right job can be a transformative experience, and we are committed to supporting jobseekers throughout their career journeys. Our recruitment services are designed to connect individuals with fulfilling jobs that offer growth and development opportunities.

Whether you're an organization seeking customized workforce solutions, outsourced services, or if you're a jobseeker searching for your next opportunity,

System One is the perfect staffing partner for you.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.