Other packages > Find by keyword >

wordpiece.data  

Data for Wordpiece-Style Tokenization
View on CRAN: Click here


Download and install wordpiece.data package within the R console
Install from CRAN:
install.packages("wordpiece.data")

Install from Github:
library("remotes")
install_github("cran/wordpiece.data")

Install by package version:
library("remotes")
install_version("wordpiece.data", "2.0.0")



Attach the package and use:
library("wordpiece.data")
Maintained by
Jon Harmon
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2021-09-28
Latest Update: 2022-03-03
Description:
Provides data to be used by the wordpiece algorithm in order to tokenize text into somewhat meaningful chunks. Included vocabularies were retrieved from <https://huggingface.co/bert-base-cased/resolve/main/vocab.txt> and <https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt> and parsed into an R-friendly format.
How to cite:
Jon Harmon (2021). wordpiece.data: Data for Wordpiece-Style Tokenization. R package version 2.0.0, https://cran.r-project.org/web/packages/wordpiece.data
Previous versions and publish date:
1.0.1 (2021-09-28 13:20), 1.0.2 (2021-10-08 23:50)
Other packages that cited wordpiece.data R package
View wordpiece.data citation profile
Other R packages that wordpiece.data depends, imports, suggests or enhances
Functions, R codes and Examples using the wordpiece.data R package
Some associated functions: dot-get_path . dot-load_inst_rds . wordpiece_vocab . 
Some associated R codes: loaders.R .  Full wordpiece.data package functions and examples
Downloads during the last 30 days
Get rewarded with contribution points by helping add
Reviews / comments / questions /suggestions ↴↴↴

Today's Hot Picks in Authors and Packages

ftaproxim  
Fault Tree Analysis Based on Proxel Simulation
Calculation and plotting of instantaneous unavailabilities of basic events along with the top event ...
Download / Learn more Package Citations See dependency  
quickcode  
Quick and Essential 'R' Tricks for Better Scripts
The NOT functions, 'R' tricks and a compilation of some simple quick plus often used 'R' codes to im ...
Download / Learn more Package Citations See dependency  
critpath  
Setting the Critical Path in Project Management
Solving the problem of project management using CPM (Critical Path Method), PERT (Program Evaluation ...
Download / Learn more Package Citations See dependency  
mistral  
Methods in Structural Reliability
Various reliability analysis methods for rare event inference (computing failure probability and qua ...
Download / Learn more Package Citations See dependency  
rdbnomics  
Download DBnomics Data
R access to hundreds of millions data series from DBnomics API (). ...
Download / Learn more Package Citations See dependency  
steepness  
Testing Steepness of Dominance Hierarchies
The steepness package computes steepness as a property of dominance hierarchies. Steepness is define ...
Download / Learn more Package Citations See dependency  

22,114

R Packages

188,080

Dependencies

55,244

Author Associations

22,115

Publication Badges

© Copyright 2022 - present. All right reserved, rpkg.net. Contact Us / Suggestions / Concerns