Data Engineer (Meta/Facebook exp) -Remote

Title: Data Engineer (Meta/Facebook exp)

Location: Remote

Rate: $ 50/hr on W2

Term: Contract

Strongly prefer CWs with prior experience at Meta

Job Summary:

Job Description: Summary:
The CWs will support efforts to perform data mitigations on large scale datasets (image, video, text) leveraged by FAIR research teams. The goal is to proactively mitigate potential risks associated with these datasets.

Job Responsibilities:
Preprocessing: converting original datasets into a format that can be consumed by mitigation pipelines.
Filtering: running filtering using Integrity's pipeline.
Post-processing: consuming filtering results to filter in the original datasets, repackaging, and re-ingestion.
Optimization: identify optimization opportunities and improve the process.

Processing data mitigations: pre-processing, executing mitigation pipelines and post-processing.

Optimization: identify optimization opportunities and improve the process.

Implement the frontend (in React) and backend (in PHP or Python) of new features.

Write and code logical and physical database descriptions and specify identifiers of database to management system or direct others in coding descriptions.

Attend project meetings and work as part of a project team to coordinate software development and determine project scope and limitations.

Skills:
Software engineering skills include writing scripts to automate file processing and data transferring, and creating tools to improve productivity and streamline workflows.
Data Management: Data pipeline building. Data processing and cleaning, transformation and formatting, data quality control and validation
Communication - effective communication skills to collaborate with stakeholders and team members

3-4 years of overall experience

Python experience a must

Some data management experience, e.g. SQL, process large data.

Background in AI building tools

React

Education/Experience:
Strongly prefer prior experience at Meta (full 2 years preferred), as this would enable them to leverage their existing knowledge of Meta's internal tools and processes, facilitating a faster onboarding process and more effective contribution to the FAIR mitigation efforts.

Bachelor's degree in computer science, software engineering or relevant field required.