Other packages > Find by keyword >

wordpiece  

R Implementation of Wordpiece Tokenization
View on CRAN: Click here


Download and install wordpiece package within the R console
Install from CRAN:
install.packages("wordpiece")

Install from Github:
library("remotes")
install_github("cran/wordpiece")

Install by package version:
library("remotes")
install_version("wordpiece", "2.1.3")



Attach the package and use:
library("wordpiece")
Maintained by
Jonathan Bratt
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2021-02-11
Latest Update: 2022-03-03
Description:
Apply 'Wordpiece' (<doi:10.48550/arXiv.1609.08144>) tokenization to input text, given an appropriate vocabulary. The 'BERT' (<doi:10.48550/arXiv.1810.04805>) tokenization conventions are used by default.
How to cite:
Jonathan Bratt (2021). wordpiece: R Implementation of Wordpiece Tokenization. R package version 2.1.3, https://cran.r-project.org/web/packages/wordpiece. Accessed 26 Jun. 2026.
Previous versions and publish date:
1.0.2 (2021-02-11 16:40), 2.0.1 (2021-10-18 20:40)
Other packages that cited wordpiece R package
View wordpiece citation profile
Other R packages that wordpiece depends, imports, suggests or enhances
Complete documentation for wordpiece
Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

colormap  
Color Palettes using Colormaps Node Module
Allows to generate colors from palettes defined in the colormap module of 'Node.js'. (see ...
Download / Learn more Package Citations See dependency  
quickcode  
Quick and Essential 'R' Tricks for Better Scripts
The NOT functions, 'R' tricks and a compilation of some simple quick plus often used 'R' codes to im ...
Download / Learn more Package Citations See dependency  
poptrend  
Estimate Smooth and Linear Trends from Population Count Survey Data
Functions to estimate and plot smooth or linear population trends, or population indices, from anim ...
Download / Learn more Package Citations See dependency  
ggblanket  
Simplify 'ggplot2' Visualisation
Simplify 'ggplot2' visualisation with 'ggblanket' wrapper functions. ...
Download / Learn more Package Citations See dependency  
PoisBinOrdNor  
Data Generation with Poisson, Binary, Ordinal and Normal Components
Generation of multiple count, binary, ordinal and normal variables simultaneously given the marginal ...
Download / Learn more Package Citations See dependency  
tactile  
New and Extended Plots, Methods, and Panel Functions for 'lattice'
Extensions to 'lattice', providing new high-level functions, methods for existing functions, panel f ...
Download / Learn more Package Citations See dependency  

27,535

R Packages

236,180

Dependencies

73,223

Author Associations

27,536

Publication Badges

© Copyright since 2022. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA