Other packages > Find by keyword >

pairwiseLLM  

Pairwise Comparison Tools for Large Language Model-Based Writing Evaluation
View on CRAN: Click here


Download and install pairwiseLLM package within the R console
Install from CRAN:
install.packages("pairwiseLLM")

Install from Github:
library("remotes")
install_github("cran/pairwiseLLM")

Install by package version:
library("remotes")
install_version("pairwiseLLM", "1.3.1")



Attach the package and use:
library("pairwiseLLM")
Maintained by
Sterett H. Mercer
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2025-12-22
Latest Update: 2025-12-22
Description:
Provides a unified framework for generating, submitting, and analyzing pairwise comparisons of writing quality using large language models (LLMs). The package supports live and/or batch evaluation workflows across multiple providers ('OpenAI', 'Anthropic', 'Google Gemini', 'Together AI', and locally-hosted 'Ollama' models), includes bias-tested prompt templates and a flexible template registry, and offers tools for constructing forward and reversed comparison sets to analyze consistency and positional bias. Results can be modeled using Bradley–Terry (1952) <doi:10.2307/2334029> or Elo rating methods to derive writing quality scores. For information on the method of pairwise comparisons, see Thurstone (1927) <doi:10.1037/h0070288> and Heldsinger & Humphry (2010) <doi:10.1007/BF03216919>. For information on Elo ratings, see Clark et al. (2018) <doi:10.1371/journal.pone.0190393>.
How to cite:
Sterett H. Mercer (2025). pairwiseLLM: Pairwise Comparison Tools for Large Language Model-Based Writing Evaluation. R package version 1.3.1, https://cran.r-project.org/web/packages/pairwiseLLM. Accessed 24 Oct. 2026.
Previous versions and publish date:
(2026-09-07 08:41), 1.1.0 (2025-12-22 20:10)
Other packages that cited pairwiseLLM R package
View pairwiseLLM citation profile
Other R packages that pairwiseLLM depends, imports, suggests or enhances
Complete documentation for pairwiseLLM
Functions, R codes and Examples using the pairwiseLLM R package
Full pairwiseLLM package functions and examples
Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

RcmdrPlugin.depthTools  
R Commander Depth Tools Plug-in
We provide an Rcmdr plug-in based on the depthTools package, which implements different robust stat ...
Download / Learn more Package Citations See dependency  
funprog  
Functional Programming
High-order functions for data manipulation : sort or group data, given one or more auxiliary func ...
Download / Learn more Package Citations See dependency  
OOBCurve  
Out of Bag Learning Curve
Provides functions to calculate the out-of-bag learning curve for random forests for any measure tha ...
Download / Learn more Package Citations See dependency  
r3PG  
Simulating Forest Growth using the 3-PG Model
Provides a flexible and easy-to-use interface for the Physiological Processes Predicting Growth (3-P ...
Download / Learn more Package Citations See dependency  
visdat  
Preliminary Visualisation of Data
Create preliminary exploratory data visualisations of an entire dataset to identify problems or une ...
Download / Learn more Package Citations See dependency  
extlasso  
Maximum Penalized Likelihood Estimation with Extended Lasso Penalty
Estimates coefficients of extended LASSO penalized linear regression and generalized linear models. ...
Download / Learn more Package Citations See dependency  

29,218

R Packages

247,686

Dependencies

77,281

Author Associations

29,081

Publication Badges

© Copyright since 2022. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA