Other packages > Find by keyword >

wordpiece  

R Implementation of Wordpiece Tokenization
View on CRAN: Click here


Download and install wordpiece package within the R console
Install from CRAN:
install.packages("wordpiece")

Install from Github:
library("remotes")
install_github("cran/wordpiece")

Install by package version:
library("remotes")
install_version("wordpiece", "2.1.3")



Attach the package and use:
library("wordpiece")
Maintained by
Jonathan Bratt
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2021-02-11
Latest Update: 2022-03-03
Description:
Apply 'Wordpiece' (<doi:10.48550/arXiv.1609.08144>) tokenization to input text, given an appropriate vocabulary. The 'BERT' (<doi:10.48550/arXiv.1810.04805>) tokenization conventions are used by default.
How to cite:
Jonathan Bratt (2021). wordpiece: R Implementation of Wordpiece Tokenization. R package version 2.1.3, https://cran.r-project.org/web/packages/wordpiece. Accessed 28 Oct. 2026.
Previous versions and publish date:
(2026-07-09 07:00), 1.0.2 (2021-02-11 16:40), 2.0.1 (2021-10-18 20:40)
Other packages that cited wordpiece R package
View wordpiece citation profile
Other R packages that wordpiece depends, imports, suggests or enhances
Complete documentation for wordpiece
Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

NPHazardRate  
Nonparametric Hazard Rate Estimation
Provides functions and examples for histogram, kernel (classical, variable bandwidth and transformat ...
Download / Learn more Package Citations See dependency  
cats  
Cohort Platform Trial Simulation
Cohort plAtform Trial Simulation whereby every cohort consists of two arms, control and experimenta ...
Download / Learn more Package Citations See dependency  
nextGenShinyApps  
Craft Exceptional 'R Shiny' Applications and Dashboards with Novel Responsive Tools
Nove responsive tools for designing and developing 'Shiny' dashboards and applications. The scripts ...
Download / Learn more Package Citations See dependency  
msamp  
Estimate Sample Size to Detect Bacterial Contamination in a Product Lot
Estimates the sample size needed to detect microbial contamination in a lot with a user-specified d ...
Download / Learn more Package Citations See dependency  
ncdf4  
Interface to Unidata netCDF (Version 4 or Earlier) Format Data Files
Provides a high-level R interface to data files written using Unidata's netCDF library (version 4 or ...
Download / Learn more Package Citations See dependency  

29,218

R Packages

247,686

Dependencies

77,281

Author Associations

29,219

Publication Badges

© Copyright since 2022. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA