Apply Now

Databricks Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago

Full Time

Remote

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

Workflow
Security Clearance
Management
Communication
Data Engineering
Extract
Transform
Load
ELT
Data Warehouse
PySpark
Apache Spark
SQL
Streaming
Agile
Databricks
DoD
Production Support
Break/Fix
FOCUS
Customer Service
Cloud Computing
Migration
Amazon Web Services
Artificial Intelligence
Biometrics
Spectrum
Business Process

Summary

Build and operate the ingestion, bronze, silver, and gold pipelines on Databricks, migrating logic and data out of legacy.

Responsibilities

Build and maintain Databricks pipelines (60% of the time)
Gather and analyze requirements (20% of the time)
Monitor and troubleshoot data jobs (10% of the time)
Document processes and workflows (10% of the time)
Perform additional assigned tasks

Requirements

ship
Secret Clearance
Excellent interpersonal skills and ability in overseeing/prioritizing work requests
Excellent written and oral communication skills
Strong data engineering, ETL/ELT development, or data warehousing
Strong PySpark and/or Spark SQL skills; solid SQL fundamentals
Solid understanding of the Medallion Architecture (Bronze/Silver/Gold layering)
Proficiency with Delta Lake (ACID transactions, schema evolution, time travel, MERGE/Upsert patterns)
Experience designing both batch and incremental/streaming ingestion pipelines
Familiarity with the Agile process

Desired Skills

Databricks Certification/experience/familiarity preferred
Knowledge of and experience with the DoD
Familiar with Customer and/or DoD IT architectures
Federal experience
Experience in post go-live production support and break/fix
Focus on customer service and responsiveness, with sound customer handling skills
Experience working within AWS Gov Cloud
Experience working migrating code from non-accredited to accredited environments within AWS

About Us
For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10153280
Position Id: 132efcd8e1850aa2ce3ac68449f4021d
Posted 1 hour ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Remote

•

5d ago

Senior Databricks Data Engineer / Technical Lead**Job Summary**We are seeking a hands-on **Senior Databricks Data Engineer / Technical Lead** to support a U.S. Department of Transportation (DOT) data modernization initiative. The role will focus on building and migrating scalable data pipelines to a **Databricks Lakehouse**, modernizing legacy data sources, and supporting production data operations.**Key Responsibilities Design and develop scalable **Databricks data pipelines** using Medallion A

Easy Apply

Full-time

Depends on Experience

Databricks Engineer

Remote

•

2d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

AWS Databricks Engineer

Remote or Chicago, Illinois

•

5d ago

AWS Databricks EngineerLocation: Chicago, IL / Remote Job type: Full time Job SummaryWe are seeking an experienced AWS Databricks Engineer to design, develop, and maintain scalable data engineering solutions using Databricks, Apache Spark, and AWS cloud services. The ideal candidate will have strong experience in data pipelines, ETL/ELT, data lake architecture, and cloud-based data processing. Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Databricks and Apache S

Easy Apply

Full-time

$120,000 - $125,000

Senior Databricks Platform Engineer

Remote

•

Today

Type of Requisition: Pipeline Clearance Level Must Currently Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Databricks Lakeflow, Databricks Platform, Data Engineering, Data Ingestion Certifications: None Experience: 10 + years of related experience ship Required: No Job Description: Seize your opportunity to make a personal impact supporting the Case Management Moderniz

Full-time

USD 169,604.00 - 229,464.00 per year

Search all similar jobs

Remote jobs at Newgen Software Technologies

Databricks Data Engineer

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs