Data Engineer

Grow your career as a Data Engineer with an innovative global bank in New Castle, DE. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week.

Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. Will work with the team responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.

Contract Duration: 11+ Months

Required Skills & Experience

• Bachelor's degree in Engineering/mathematical or scientific background.
• Hard core Spark/Scala/Java/HDFS experience.
• 10+ years of experience in Hadoop/Big Data technologies.
• 5+ years of hands-on experience as a Scala Developer (with previous Java background).
• Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event-based messaging.
• Relational and NoSQL database integration and data distribution principles experience.
• Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr).
• Experience with API development and use of JSON/XML/Hypermedia data formats.
• Strong development/automation skills.
• Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.).

Desired Skills & Experience

• Experience in Core Banking functionality for generating various hand-offs.
• Experience with containerization and related technologies (e.g. Docker, Kubernetes).
• Comprehensive knowledge of the principles of software engineering and data analytics.
• Knowledge of Agile (Scrum) development methodology.
• Cloudera/Hortonworks/AWS EMR, S3 experience.

What You Will Be Doing

• Work closely with full stack data engineers, product managers, cross-functional partners, and the larger technology organization to get high-quality products and new features built, tested, and released on time for Information Management team, part of Operations & Technology at the company.
• Responsible for many fast-changing, moving parts and get them to come together as a product.
• Responsible for identifying and managing risks, making sound judgments about quality, and speed of deliverables and deployment to production.
• Key player in the Data Transformation to digitize the business.
• Responsible for leading development on the Big Data platform. The platform supports operational real-time event-based processing and compute applications as well as analytics consumption use cases including machine/deep learning.
• Be part of the team responsible for building and maintaining a multitude of applications including:
  • Real-time ingestion/stream processing and data distribution via Big Data APIs.
  • Build out canonical models and data conformance.
  • Implement best in class data management and data ingestion.
  • Leverage new storage engines like Kudu that enables analytics on fast changing data.
  • Leverage GPU implementation to enable advanced Machine Learning.
  • Enhance self-service capability for data science and ML practitioners.
• Hands-on development role that will offer exposure to the full development cycle, whilst working closely with the business and technology stakeholders.
• Analysis and development across lines of business.
• Cross train and fertilize functional and technical knowledge.
• Align to Engineering Excellence Development principles and standards.
• Promote and increase Development Productivity scores for coding.
• Fully adhere to and evangelize a full Continuous Integration and Continuous Deploy pipeline.