Job Title: Abinitio Developer
Location: Reston, VA
Duration: 12 Months Contract
Candidates from DC, MD, VA or within drivable distance only can apply
The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.
Essential Functions:
1) Work with Business Analysts and Product team to gather data requirements
2) Design and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queues
3) Transform the data to create a consumable data layer for various application uses
4) Support Data pipeline with bug fixes, and additional enhancements
5) Document Technical design , Operational Runbook etc
Required Experience:
Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area
Must have at least 5 years of ETL Design and Development experience using Ab Initio
1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera
AbInitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to have
Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies
Working knowledge in various AWS services is nice to have
Sound understanding of SQL and ability to write well performing SQL queries
Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals
Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components
Ability to unit test the code thoroughly and to troubleshoot issues in production environments