Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
-
Updated
Nov 23, 2024 - TypeScript
#
ai-evaluation
Here are 10 public repositories matching this topic...
Hallucinations (Confabulations) Document-Based Benchmark for RAG
benchmark
leaderboard
gemini
llama
language-model
claude
rag
hallucinations
ai-evaluation
llm
llm-benchmarking
gpt-4o
o1-mini
o1-preview
confabulations
-
Updated
Nov 5, 2024 - HTML
Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.
nlp
machine-learning
gemini
llama
language-model
model-evaluation
ai-safety
mistral
claude
disinformation
ai-security
ai-benchmarks
ai-evaluation
llm
llm-benchmarking
gpt4o
-
Updated
Oct 22, 2024
RJafroc quick start for those already familiar with windows jafroc
-
Updated
Dec 28, 2023 - TeX
Adaptive Testing Framework for AI Models (Psychometrics in AI Evaluation)
-
Updated
Oct 1, 2024 - Jupyter Notebook
Repository for the LWDA'24 presentation on 'Psychometric Profiling of GPT Models for Bias Exploration', featuring conference materials including the poster, paper, slides, and references.
ai-safety
personality-traits
interpretability
cognitive-bias
explainability
ai-evaluation
gpt-models
machine-psychology
ai-bias
psychometric-analysis
lwda24
-
Updated
Sep 23, 2024 - TeX
Improve this page
Add a description, image, and links to the ai-evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-evaluation topic, visit your repo's landing page and select "manage topics."