BI Analyst/Report Developer

Hybrid in Malvern, PA, US • Posted 2 hours ago • Updated 2 hours ago
Contract Independent
Contract W2
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Business Intelligenece
  • SQL
  • UAT

Summary

Qualifications

Required Skills & Experience

  • Robust SQL skills required.
  • Robust analytical background with experience in data validation, SQL, and analytics workflows
  • Ability to assess outputs both quantitatively (data accuracy) and qualitatively (reasonableness, business context)
  • Demonstrated critical thinking and sound judgment, especially in ambiguous or non-deterministic environments
  • Experience working with large datasets, reporting tools, or analytics platforms

Preferred Qualifications

  • Exposure to AI/ML or generative AI tools and associated testing or validation frameworks
  • Experience in scenario-based testing, UAT, or model validation
  • Familiarity with financial services, retirement, or plan sponsor analytics

Job Responsibilities

1. Deterministic Testing & Data Validation

  • Validate generative AI tool outputs for structured, rules-based use cases by reconciling results against trusted data sources and established SQL-based metrics.
  • Ensure consistency, explainability, and auditability of outputs by confirming alignment with existing data pipelines and query logic
  • Expand and maintain test coverage across prioritized use cases to establish a robust, high-confidence baseline for the platform
  • Partner with data engineering and analytics teams to identify and resolve discrepancies in underlying data or logic

2. Non-Deterministic Testing & Scenario Evaluation

  • Design and execute scenario-based testing for more complex, AI-driven outputs where direct validation is not always possible
  • Evaluate results based on intent accuracy, reasonableness, and confidence thresholds rather than exact match validation
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172358
  • Position Id: 8990318
  • Posted 2 hours ago
Contact the job poster
NG

Nooruddin Ghani

Senior Technical Recruiter @ Drevol LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Malvern, Pennsylvania

Today

Easy Apply

Contract

Depends on Experience

Phoenixville, Pennsylvania

25d ago

Easy Apply

Contract

Depends on Experience

Wayne, Pennsylvania

Today

Easy Apply

Third Party, Contract

Depends on Experience

Radnor, Pennsylvania

Today

Easy Apply

Contract

Search all similar jobs