Overview
Skills
Job Details
Position : Senior Data Engineer
Location : Reston Virginia Hybrid
Direct Client Requirement
NOTES FROM MANAGER :
This position requires strong Java programming skills along with other skills already listed on the req.
Data engineers with a good background in Hadoop and solid AWS as mostly of the work is being migrated to AWS.
Kafka is IMP and they should know of the programming languages like Java
Job Description :
7+ years of strong programming background with Java/Python/Scala
At least 3+ years of experience working on Data Integration projects using Hadoop MapReduce, Sqoop, Oozie , Hive, Spark and other related Big Data technologies
At least 2+ years of experience on AWS preferably leveraging services such as Lambda, S3, Redshift, Glue services
Some working experience building Kafka based data ingestion/retrieval programs
Experience tuning Hadoop/Spark/hive parameters for optimal performance
Strong SQL query writing and data analysis skill
Good shell scripting experience
Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components
big data engineer role with solid AWS experience; once a week in person at Reston office mostly.