Databricks Developer: Java Spark (MBI Clearance Required)

Overview

Contract - W2
Contract - Independent
Contract - 12+

Skills

TestNG
Java
Python
Kubernetes
Jenkins
agile
kafka
api
scala
sql
GitHub
Gradle
Big data
EMR
Scrum
Confluence
GIT
Grafana
debug
Best Practices
Documentation
Database Modeling
Continuous Integration/Delivery
Junit
DEV OPS
Avro
Deployment
APM
Streaming
Apache
Real-Time
Prometheus
Maven
ETL
Performance Tuning
Hive
Apache Spark
User Interface
Version Control
Governance
Design Patterns
Data Structures
Object-Oriented Design
Regression Testing
Ecosystem
Data Validation
Data modeling
Data Pipelines
Unit Testing
Gather Requirements
Performance Optimization
Data Cleansing
Hbase
Datasets
OOP
HDFS
Apache Hadoop HDFS
Passport

Job Details

Greetings for the day !!

My name is Bril, and I am Technical Recruiter, Talent Acquisition for Resourcesys Inc. We are looking for a
Requirement: 1

Databricks Developer: Java Spark

Start Date: onboarding takes 3-4 weeks
Position Type: Contract
Location: Remote
Active IRS MBI Clearance Required. IRS issued laptop strongly preferred. Please provide a copy of the candidate's active MBI letter.
Task Description:
The Databricks Developer will be responsible for designing, developing, and maintaining scalable data processing solutions on the Databricks platform, with a focus on integrating and transforming IRS datasets such as the Information Returns Master File (IRMF), Business Master File (BMF), and Individual Master File (IMF). This role requires advanced proficiency in Java and Apache Spark, and a deep understanding of big data processing, performance optimization, and secure data handling in a federal environment.
Required skills/Level of Experience:
We are seeking a Databricks Developer with deep expertise in Java and Apache Spark, along with hands-on experience working with IRS data systems such as IRMF, BMF, or IMF. The ideal candidate will be responsible for designing, developing, and optimizing big data pipelines and analytics solutions on the Databricks platform. This role requires a deep understanding of distributed data processing, performance tuning, and scalable architecture.
'
Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Implement data processing logic in Java 8+, leveraging functional programming and OOP best practices
  • Integrate with IRS data systems including IRMF, BMF, or IMF
  • Optimize Spark jobs for performance, reliability, and cost-efficiency
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions
  • Ensure compliance with data security, privacy, and governance standards
  • Troubleshoot and debug production issues in distributed data environments
Required Skills & Qualifications:
  • Active IRS MBI Clearance Required. IRS issued laptop strongly preferred. Please provide a copy of the candidate's active MBI letter.
  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • 8+ years of professional experience demonstrating the required technical skills and responsibilities listed:
IRS Data Systems Experience
  • Hands-on experience working with IRS IRMF, BMF, or IMF datasets
  • Understanding of IRS data structures, compliance, and security protocols
Programming Language Proficiency
  • Strong expertise in Java 8 or higher
  • Experience with functional programming (Streams API, Lambdas)
  • Familiarity with object-oriented design patterns and best practices
Apache Spark
  • Proficient in Spark Core, Spark SQL, and DataFrame/Dataset APIs
  • Understanding of RDDs and when to use them
  • Experience with Spark Streaming or Structured Streaming
  • Skilled in performance tuning and Spark job optimization
  • Ability to use Spark UI for troubleshooting stages and tasks
Big Data Ecosystem
  • Familiarity with HDFS, Hive, or HBase
  • Experience integrating with Kafka, S3, or Azure Data Lake
  • Comfort with Parquet, Avro, or ORC file formats
Data Processing and ETL
  • Strong understanding of batch and real-time data processing paradigms
  • Experience building ETL pipelines with Spark
  • Proficient in data cleansing, transformation, and enrichment
DevOps / Deployment
  • Experience with YARN, Kubernetes, or EMR for Spark deployment
  • Familiarity with CI/CD tools like Jenkins or GitHub Actions
  • Monitoring experience with Grafana, Prometheus, Datadog, or Spark UI logs
Version Control & Build Tools
  • Proficient in Git
  • Experience with Maven or Gradle
Testing
  • Unit testing with JUnit or TestNG
  • Experience with Mockito or similar mocking frameworks
  • Data validation and regression testing for Spark jobs
Soft Skills / Engineering Practices
  • Experience working in Agile/Scrum environments
  • Strong documentation skills (Markdown, Confluence, etc.)
  • Ability to debug and troubleshoot production issues effectively
  • Preferred Qualifications:
  • Experience with Scala or Python in Spark environments
  • Familiarity with Databricks or Google DataProc
  • Knowledge of Delta Lake or Apache Iceberg
  • Experience with data modeling and performance design for big data systems
Nice to have skills:
  • Experience with Scala or Python in Spark environments
  • Familiarity with Databricks or Google DataProc
  • Knowledge of Delta Lake or Apache Iceberg
  • Data modeling and performance design for big data systems.

Submission Format :

Name of the Candidate:

Full Address with ZIP Code:

Contact Number:

Email ID

Alternate Email ID (Must)

Work Authorization:(or H1)

Expected Salary/Pay Rate

Education Details with year of Graduation (Both Bachelors and Masters)

Earliest Availability to Join:

LinkedIn ID

Passport No Must

References (Minimum 2, Name , contact number)

SSN last 4 digit














Many Thanks & Regards,
Bril Logan

Resourcesys
10294 A Baltimore National Park, Ellicott City, MD - 21042 | Ellicott City, MD
Office : Ext 105 || Email:
Tell : 201-8555-866 - WhatsApp /
Website Address: http
Follow Us:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.