R package citation, R package reverse dependencies, R package scholars, install an r package from GitHub hy is package acceptance pending why is package undeliverable amazon why is package on hold dhl tour packages why in r package r and r package full form why is r free why r is bad which r package to install which r package has which r package which r package version which r package readxl which r package ggplot which r package fread which r package license where is package.json where is package-lock.json where is package.swift where is package explorer in eclipse where is package where is package manager unity where is package installer android where is package manager console in visual studio who r package which r package to install which r package version who is package who is package deal who is package design r and r package full form r and r package meaning what r package has what package r what is package in java what is package what is package-lock.json what is package in python what is package.json what is package installer do r package can't install r packages r can't find package r can't load package can't load xlsx package r can't install psych package r can't install sf package r Write if else in NONMEM pk pd
evaluatellm
View on CRAN: Click
here
Download and install evaluatellm package within the R console
Install from CRAN:
install.packages("evaluatellm")
Install from Github:
library("remotes")
install_github("cran/evaluatellm") Install by package version:
library("remotes")
install_version("evaluatellm", "0.1.0") Attach the package and use:
library("evaluatellm")
Maintained by
Charles Coverdale
[Scholar Profile | Author Map]
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2026-09-15
Latest Update: 2026-09-15
Description:
Treats language model evaluations as statistical experiments and supplies the inference they require. Provides central limit theorem and cluster-robust standard errors for evaluation scores, paired and unpaired model comparisons, variance decomposition when several responses are drawn per question, control-variate variance reduction, multiplicity adjustment across benchmark suites, and power and minimum detectable effect calculations for planning evaluations, following Miller (2024) <doi:10.48550/arXiv.2411.00640>. For evaluations scored by a model judge, implements agreement statistics against a human gold standard and prediction-powered inference (Angelopoulos et al. 2023) <doi:10.1126/science.adi6000> with the power-tuned estimator of Angelopoulos, Bates and Jordan (2023) <doi:10.48550/arXiv.2311.01453>, so a small set of human labels debiases a large set of judge scores. Leaderboards are supported through bootstrap rank intervals and Bradley-Terry ratings (Bradley and Terry 1952) <doi:10.2307/2334029>. Accepts scores from any evaluation harness.
How to cite:
Charles Coverdale (2026). evaluatellm: Statistical Inference for Language Model Evaluations. R package version 0.1.0, https://cran.r-project.org/web/packages/evaluatellm. Accessed 04 Oct. 2026.
Previous versions and publish date:
No previous versions
Other packages that cited evaluatellm R package
View evaluatellm citation profile
Other R packages that evaluatellm depends,
imports, suggests or enhances
Complete documentation for evaluatellm
Functions, R codes and Examples using
the evaluatellm R package
Full evaluatellm package
functions and examples
Downloads during the last 30 days
Today's Hot Picks in Authors and Packages
skilljaR
Functions that simplify calls to the 'Skilljar' API. See < ...
Download / Learn more Package Citations See dependency
Download / Learn more Package Citations See dependency
Maintainer: Chris Umphlett (view profile)
r2resize
Automatic resizing toolbar for containers, images and tables. Various resizable or expandable contai ...
Download / Learn more Package Citations See dependency
Download / Learn more Package Citations See dependency
Maintainer: Obinna Obianom (view profile)
plotbb
Proof of concept for implementing grammar of graphics using base plot. The bbplot() function initial ...
Download / Learn more Package Citations See dependency
Download / Learn more Package Citations See dependency
Maintainer: Guangchuang Yu (view profile)
rWishart
An expansion of R's 'stats' random wishart matrix generation.
This package allows the user to gener ...
Download / Learn more Package Citations See dependency
Download / Learn more Package Citations See dependency
Maintainer: Ben Barnard (view profile)
28,905
R Packages
247,686
Dependencies
76,495
Author Associations
28,906
Publication Badges
