Job Title: Data Researcher Duration: 12+ Months contract with extension Location: Elk Grove, CA or Austin, TX Or Sunnyvale, CA (Onsite on every Tuesday, Wednesday, and Thursday) About the Role We are seeking a highly analytical Data Researcher with a strong background in Data Science, Experimental Research, and Generative AI to evaluate the effectiveness of AI-powered analytics agents.
This role is ideal for someone who enjoys applying scientific methodology to solve complex problems. Rather than simply building AI solutions, you will rigorously design experiments, evaluate AI agent performance, analyze results, and provide evidence-based recommendations on whether Generative AI can reliably answer analytical questions.
The successful candidate will combine expertise in Python, SQL, Snowflake, AI/LLM technologies, statistical experimentation, and research methodology to build reproducible experiments and measure AI system performance.
Key Responsibilities - Design, build, and evaluate Generative AI-powered analytics agents.
- Develop controlled experiments to evaluate AI agent performance.
- Form hypotheses and design statistically sound research methodologies.
- Measure model accuracy, repeatability, reliability, and failure modes.
- Analyze experimental results and communicate findings with quantitative evidence.
- Evaluate different LLM configurations including prompting strategies, model parameters, RAG, and agent architectures.
- Define analytical metrics and establish evaluation baselines.
- Create reproducible research documentation, structured experiment logs, and technical reports.
- Collaborate with Data Scientists, AI Engineers, Product teams, and business stakeholders.
- Present research findings and recommendations to technical and executive audiences.
Required Qualifications - Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Machine Learning, Artificial Intelligence, or a related discipline.
- 5+ years of experience in Data Science using:
- 3+ years of experience designing and conducting controlled experiments, including:
- Hypothesis testing
- Experimental design
- Baseline creation
- Bias reduction
- Statistical evaluation
- 3+ years evaluating ML models or AI systems using:
- Error analysis
- Variability measurement
- Reproducibility testing
- Performance benchmarking
- 1+ year of hands-on experience with Generative AI, including:
- LLMs
- Prompt Engineering
- AI Agents
- Retrieval-Augmented Generation (RAG)
- API-based model interaction
- Model parameter tuning (temperature, top-p, etc.)
- Statistical analysis
- Data quality
- Analytical metrics
- Experimental research
- Experience maintaining reproducible research documentation.
- Excellent communication and presentation skills.
Preferred Qualifications - Experience evaluating Large Language Models (LLMs) for correctness, consistency, and repeatability.
- Experience with Tableau or other BI/Visualization platforms.
- Experience in Operations, Support, or IT Analytics.
- Experience presenting research findings to leadership or executive stakeholders.
- Familiarity with LangChain, LangGraph, CrewAI, AutoGen, or similar AI agent frameworks.
About PTR Global: PTR Global is a leading provider of information technology and workforce solutions. PTR Global has become one of the largest providers in its industry, with over 5000 professionals providing services across the U.S. and Canada. For more information visit
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:
- Pay any fee to be considered for, submitted to, or selected for any opportunity.
- Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
- Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.
Pay Range: $65/hr. to $75/hr. The specific compensation for this position will be determined by several factors, including the scope, complexity, and location of the role, as well as the cost of labor in the market; the skills, education, training, credentials, and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits, including medical, dental, vision, and 401K contributions, as well as PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.
If you receive a suspicious message, email, or phone call claiming to be from PTR Global, do not respond or click on any links. Instead, contact us directly at +1 . To report any concerns, please email us at
#LI-NP3
Never miss an opportunity! Create an alert based on the job you applied for.