Overview
On Site
USD 181,100.00 - 318,400.00 per year
Full Time
Skills
Dashboard
Build Tools
Storage
Computer Science
Data Science
Data Engineering
Pandas
Python
Tableau
Data Collection
Visualization
Science
Statistics
Communication
Reporting
Computational Linguistics
Payments
Job Details
As part of the work on machine-generated dialog we are developing novel measurements of its quality. These include cutting-edge llm-judges for aspects like groundedness (lack of hallucinations), Siri Tone and Style (a suite of Design requirements), Safety, and others.
Description To measure our progress on this front, we need to track the state of our dataset composition, accuracy of llm-judges, human expert review results in a central and visual representation. A DRI for Metrics and Reporting will:
Responsibilities
Minimum Qualifications
Preferred Qualifications
Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .
Description To measure our progress on this front, we need to track the state of our dataset composition, accuracy of llm-judges, human expert review results in a central and visual representation. A DRI for Metrics and Reporting will:
Responsibilities
- Build an easy to use dashboard for our datasets - requires integration with other teams
- Build dashboards to visualize our status
- Help define useful metrics
- Build tools to facilitate processing of human review results (inter-annotator agreement, storage, selection of the most useful data points for human expert review)
Minimum Qualifications
- B.S., M.S. or Ph.D. in Computer Science, Data Science, Data Engineering
- 3+ years in data-science and/or data-engineering (iceberg, pandas python, Tableau or equivalent, data collection and visualization)
- Good understanding of metrics, crowd science, annotation analysis, statistics
- Ability to work independently and cross-functionally to integrate in partner team reporting systems and pipelines
- Excellent communication skills and the ability to thrive in a highly collaborative work environment
Preferred Qualifications
- Good engineering practices to create sustainable and easy to use metric reporting pipelines
- Attunement to computational linguistics, language quality is a plus
Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.