Overview
Remote
$60 - $70
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 6 Month(s)
Able to Provide Sponsorship
Skills
Agile
Apache Hive
Apache Maven
Extract
Transform
Load
Data Cleansing
Debugging
Data Processing
Continuous Integration
Kubernetes
Microsoft Azure
Performance Tuning
Electronic Health Record (EHR)
Functional Programming
Apache Kafka
Confluence
Continuous Delivery
Documentation
Apache Spark
Amazon S3
API
Scrum
Testing
Job Details
TITLE- Senior Data bricks Developer with Java and Spark Experience
LOCATION- remote
DURATION- long term
INTERVIEW- video
We need candidates with Active IRS Mbi clearance.
Required Skills & Qualifications:
- Bachelor s degree in Computer Science, Information Systems, or a related field.
- 8+ years of professional experience demonstrating the required technical skills and responsibilities listed:
Programming Language Proficiency
- Strong expertise in Java 8 or higher
- Experience with functional programming (Streams API, Lambdas)
- Familiarity with object-oriented design patterns and best practices
Apache Spark
- Proficient in Spark Core, Spark SQL, and DataFrame/Dataset APIs
- Understanding of RDDs and when to use them
- Experience with Spark Streaming or Structured Streaming
- Skilled in performance tuning and Spark job optimization
- Ability to use Spark UI for troubleshooting stages and tasks
Big Data Ecosystem
- Familiarity with HDFS, Hive, or HBase
- Experience integrating with Kafka, S3, or Azure Data Lake
- Comfort with Parquet, Avro, or ORC file formats
Data Processing and ETL
- Strong understanding of batch and real-time data processing paradigms
- Experience building ETL pipelines with Spark
- Proficient in data cleansing, transformation, and enrichment
DevOps / Deployment
- Experience with YARN, Kubernetes, or EMR for Spark deployment
- Familiarity with CI/CD tools like Jenkins or GitHub Actions
- Monitoring experience with Grafana, Prometheus, Datadog, or Spark UI logs
Version Control & Build Tools
- Proficient in Git
- Experience with Maven or Gradle
Testing
- Unit testing with JUnit or TestNG
- Experience with Mockito or similar mocking frameworks
- Data validation and regression testing for Spark jobs
Soft Skills / Engineering Practices
- Experience working in Agile/Scrum environments
- Strong documentation skills (Markdown, Confluence, etc.)
- Ability to debug and troubleshoot production issues effectively
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.