Data Engineer

Job Title: Data Pipeline Engineer

Location: 100% onsite in NYC (Chelsea) or DC (Georgetown) – Need Local

Contract

The Role

As a Subcontractor Engineer - USG you will help develop and deploy technical solutions to solve our customers’ hardest problems, using our platform to integrate data, transform insights, and build first-class applications for operational decisions. You will leverage everything around you: core company products, open-source technologies (e.g. GHE), and anything you and your team can build to drive real impact. In this role, you work with customers around the globe, where you gain rare insight into the world’s most important industries and institutions. Each mission presents different challenges, from the regulatory environment to the nature of the data to the user population. You will work to accommodate all aspects of an environment to drive real technical outcomes for our customers!

Core Responsibilities

• Setup transfers of data feeds from source systems into location accessible to Foundry
• Debug issues related to delayed or missing data feeds
• Write transformations and derive new datasets using Spark for distributed computation
• Monitor build progress and debug build problems
• Using Foundry’s application development framework to design applications that address operational questions
• Rapid development and iteration cycles with SME’s including testing and troubleshooting application issues
• Executing requests for information (RFI’s) surrounding the platform’s data footprint
• Iterate with product teams while debugging / understanding the code backing our core platform

What We Value

• Strong engineering background, preferably in fields such as Computer Science, Mathematics, Software Engineering, Physics, or Data Science.
• Proficiency with programming languages such as Python (PySpark, Pandas) SQL, R or similar languages.
• Strong understanding of algorithms and data structures as they pertain to development / problem solving
• Ability to work effectively in teams of technical and non-technical individuals.
• Skill and comfort working in a rapidly changing environment with dynamic objectives and iteration with users.
• Demonstrated ability to continuously learn, work independently, and make decisions with minimal supervision.
• Proven track-record of strong customer communications including feedback gathering, execution updates, and troubleshooting.

What We Require

• Minimum Secret Clearance