Other packages > Find by keyword >

wordpiece  

R Implementation of Wordpiece Tokenization
View on CRAN: Click here


Download and install wordpiece package within the R console
Install from CRAN:
install.packages("wordpiece")

Install from Github:
library("remotes")
install_github("cran/wordpiece")

Install by package version:
library("remotes")
install_version("wordpiece", "2.1.3")



Attach the package and use:
library("wordpiece")
Maintained by
Jonathan Bratt
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2021-02-11
Latest Update: 2022-03-03
Description:
Apply 'Wordpiece' (<doi:10.48550/arXiv.1609.08144>) tokenization to input text, given an appropriate vocabulary. The 'BERT' (<doi:10.48550/arXiv.1810.04805>) tokenization conventions are used by default.
How to cite:
Jonathan Bratt (2021). wordpiece: R Implementation of Wordpiece Tokenization. R package version 2.1.3, https://cran.r-project.org/web/packages/wordpiece. Accessed 05 Aug. 2026.
Previous versions and publish date:
(2026-07-09 07:00), 1.0.2 (2021-02-11 16:40), 2.0.1 (2021-10-18 20:40)
Other packages that cited wordpiece R package
View wordpiece citation profile
Other R packages that wordpiece depends, imports, suggests or enhances
Complete documentation for wordpiece
Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

kernelPSI  
Post-Selection Inference for Nonlinear Variable Selection
Different post-selection inference strategies for kernelselection as described in kernelPSI a Post-S ...
Download / Learn more Package Citations See dependency  
quickcode  
Quick and Essential 'R' Tricks for Better Scripts
The NOT functions, 'R' tricks and a compilation of some simple quick plus often used 'R' codes to im ...
Download / Learn more Package Citations See dependency  
dcov  
A Fast Implementation of Distance Covariance
Efficient methods for computing distance covariance and relevant statistics. See Sz ...
Download / Learn more Package Citations See dependency  
noisyr  
Noise Quantification in High Throughput Sequencing Output
Quantifies and removes technical noise from high-throughput sequencing data. Two approaches are use ...
Download / Learn more Package Citations See dependency  
dhReg  
Dynamic Harmonic Regression
Building and forecasting time series data with multiple seasonality using Dynamic Harmonic Regressio ...
Download / Learn more Package Citations See dependency  

28,083

R Packages

239,283

Dependencies

74,457

Author Associations

28,084

Publication Badges

© Copyright since 2022. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA