Lead Big Data Developer

Overview

On Site
Contract - W2

Skills

Financial services
Business requirements
Specification
Leadership
Design
Code review
Production support
Operations
Data quality
Machine Learning (ML)
Data
Electronic Health Record (EHR)
Apache Spark
Amazon DynamoDB
Database
Amazon Lambda
JSON
Computerized system validation
SQL
Performance tuning
Optimization
Storage
Apache Parquet
Data compression
Writing
Unix
Shell
Unit testing
JUnit
Git
Apache Maven
Gradle
Continuous integration
Continuous delivery
Software development
Java
Scala
Extract
transform
load
Big data
API
RESTful
Scrum
Agile
Creativity
Analytical skill
Problem solving
Cloud computing
Process modeling
Process management
Business process management
Amazon Web Services
Step-Functions
Python
Scripting
Performance testing
Apache JMeter
MEAN stack
Customer service
Training and development
SAP BASIS
Policies

Job Details

Software Guidance & Assistance, Inc., (SGA), is searching for aSr. Java/Big Data developer for a Contract engagement with a financial services firm in Rockville, MD.

This position is 100% Remote.

Responsibilities :
  • Understand complex business requirements
  • Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
  • Develop automated unit tests, functional tests and performance tests.
  • Maintain optimal data pipeline architecture
  • Design ETL jobs for optimal execution in AWS cloud environment
  • Reduce processing time and cost of ETL workloads
  • Lead peer reviews and design/code review meetings
  • Provide support for production support operations team
  • Implement data quality checks.
  • Identify areas where machine learning can be used to identify data anomalies
Required Skills:
  • Strong experience in Java or Scala
  • Strong experience in big data technologies like AWS EMR, AWS EKS, Apache Spark
  • Strong experience with serverless technologies like AWS Dynamo DB, AWS Lambda
  • Strong experience in processing with JSON and csv files
  • Must be able to write complex SQL queries
  • Experience in performance tuning and optimization
  • Familiar with columnar storage formats (ORC, Parquet) and various compression techniques
  • Experience in writing Unix shell scripts
  • Unit testing using JUnit or ScalaTest
  • Git/Maven/Gradle
  • Code Reviews
  • Experience with CI/CD pipelines
  • Agile
Experience & Qualifications :
  • 7+ years of experience in programming language Java or Scala
  • 7+ years of experience in ETL projects
  • 5+ years of experience in big data projects
  • 3+ years of experience with API development (REST API's)
  • Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology
  • Strong and creative analytical and problem-solving skills
Preferred Skills:
  • AWS Cloud
  • BPM/ AWS Step Functions
  • Python scripting
  • Performance testing tools like Gatling or JMeter

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.