Other packages > Find by keyword >

wordpiece  

R Implementation of Wordpiece Tokenization
View on CRAN: Click here


Download and install wordpiece package within the R console
Install from CRAN:
install.packages("wordpiece")

Install from Github:
library("remotes")
install_github("cran/wordpiece")

Install by package version:
library("remotes")
install_version("wordpiece", "2.1.3")



Attach the package and use:
library("wordpiece")
Maintained by
Jonathan Bratt
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2021-02-11
Latest Update: 2022-03-03
Description:
Apply 'Wordpiece' (<doi:10.48550/arXiv.1609.08144>) tokenization to input text, given an appropriate vocabulary. The 'BERT' (<doi:10.48550/arXiv.1810.04805>) tokenization conventions are used by default.
How to cite:
Jonathan Bratt (2021). wordpiece: R Implementation of Wordpiece Tokenization. R package version 2.1.3, https://cran.r-project.org/web/packages/wordpiece. Accessed 05 Jun. 2026.
Previous versions and publish date:
1.0.2 (2021-02-11 16:40), 2.0.1 (2021-10-18 20:40)
Other packages that cited wordpiece R package
View wordpiece citation profile
Other R packages that wordpiece depends, imports, suggests or enhances
Complete documentation for wordpiece
Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

msm  
Multi-State Markov and Hidden Markov Models in Continuous Time
Functions for fitting continuous-time Markov and hidden Markov multi-state models to longitudinal d ...
Download / Learn more Package Citations See dependency  
quickcode  
Quick and Essential 'R' Tricks for Better Scripts
The NOT functions, 'R' tricks and a compilation of some simple quick plus often used 'R' codes to im ...
Download / Learn more Package Citations See dependency  
envirem  
Generation of ENVIREM Variables
Generation of bioclimatic rasters that are complementary to the typical 19 bioclim variables. ...
Download / Learn more Package Citations See dependency  
crossurr  
Cross-Fitting for Doubly Robust Evaluation of High-Dimensional Surrogate Markers
Doubly robust methods for evaluating surrogate markers as outlined in: Agniel D, Hejblum BP, Thiebau ...
Download / Learn more Package Citations See dependency  
ibb  
R Wrapper for Istanbul Municipality Open Data Portal
Call wrappers for Istanbul Metropolitan Municipality's Open Data Portal (Turkish: Istanbul B ...
Download / Learn more Package Citations See dependency  

27,268

R Packages

233,548

Dependencies

72,590

Author Associations

27,205

Publication Badges

© Copyright since 2022. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA