Data Engineer

Python, Java, Apache Kafka and Spark, Big Data, Scala Must Have
Contract W2, 6 Months
Depends on Experience

Job Description

Data Engineer

Please note:

Candidates MUST take Glider Test

             Client is unable to sponsor visa candidates for these positions

Immediate interviews – Mon- Fri from 4 – 5 PM EST


Data Engineers – 11 Positions

Location: Richmond, VA

Duration : 8-9 months contract to  hire


1- Spark ETL experience Hands-on and put things into production. Done design & support.  

2- Built and designed data marts and familiar with data modeling.  

3- Solid experience working in AWS environment 



Basic Qualifications:


  • At least 8 years of experience with the Software Development Life Cycle (SDLC)
  • At least 5 years of experience working on a big data platform
  • At least 3 years of experience working with unstructured datasets
  • At least 3 years of experience developing microservices: Python, Java, or Scala
  • At least 1 year of experience building data pipelines, CICD pipelines, and fit for purpose data stores
  • At least 1 year of experience in cloud technologies: AWS, Docker, Ansible, or Terraform
  • At least 1 year of Agile experience
  • At least 1 year of experience with a streaming data platform including Apache Kafka and Spark


Preferred Qualifications:


  • 5+ years of data modeling and data engineering skills
  • 3+ years of microservices architecture & RESTful web service frameworks
  • 3+ years of experience with JSON, Parquet, or Avro formats
  • 2+ years of creating data quality dashboards establishing data standards
  • 2+ years experience in RDS, NOSQL or Graph Databases
  • 2+ years of experience working with AWS platforms, services, and component technologies, including S3, RDS and Amazon EMR



Overall Responsibility :


Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers.

Apply domain driven design practices to build out data applications. Experience in building out conceptual and logical models.

Build out data consumption views and provisioning self-service reporting needs via demonstrated dimensional modeling skills.

Measuring data quality and making improvements to data standards, helping application teams to publish data in the correct format so it becomes easy for downstream consumption.

Big Data applications using Open Source frameworks like Apache Spark, Scala and Kafka on AWS and Cloud based data warehousing services such as Snowflake.

Build pipelines to enable features to be provisioned for machine learning models. Familiar with data science model building concepts as well as consuming and from data lake.

Posted By

Rizwan Khan

Dice Id : 91111989
Position Id : DATA_VA
Originally Posted : 1 month ago
Have a Job? Post it

Similar Positions

Sr. Data Engineer
  • Idexcel Inc.
  • Richmond, VA
Data Engineer
  • CSI Consulting
  • Richmond, VA
Data Engineer
  • Keylent
  • Richmond, VA
Data Engineer
  • Amiti Consulting, Inc
  • Richmond, VA
Data Engineer
  • Net2Source Inc.
  • Richmond, VA
Data Engineer
  • Nuvento
  • Richmond, VA
Data Engineers
  • SoftHQ, Inc.
  • Richmond, VA
Data Engineer
  • Faaz Consulting LLC
  • Richmond, VA
Data Engineer with Microservices
  • XFORIA Inc
  • Richmond, VA
Mid level Data Engineer
  • Virtue Group
  • Richmond, VA
Sr. Data Engineer
  • Lorvenk Technologies LLC
  • Richmond, VA
Data Engineer
  • Richmond, VA
AWS/Big Data/JAVA Engineers
  • S&R IT Inc.
  • Richmond, VA