Other packages > Find by keyword >

sparkwarc  

Load WARC Files into Apache Spark
View on CRAN: Click here


Download and install sparkwarc package within the R console
Install from CRAN:
install.packages("sparkwarc")

Install from Github:
library("remotes")
install_github("cran/sparkwarc")

Install by package version:
library("remotes")
install_version("sparkwarc", "0.1.6")



Attach the package and use:
library("sparkwarc")
Maintained by
Edgar Ruiz
[Scholar Profile | Author Map]
All associated links for this package
First Published: 2017-01-10
Latest Update: 2022-01-11
Description:
Load WARC (Web ARChive) files into Apache Spark using 'sparklyr'. This allows to read files from the Common Crawl project <http://commoncrawl.org/>.
How to cite:
Edgar Ruiz (2017). sparkwarc: Load WARC Files into Apache Spark. R package version 0.1.6, https://cran.r-project.org/web/packages/sparkwarc. Accessed 07 Nov. 2024.
Previous versions and publish date:
0.1.0 (2017-01-10 19:03), 0.1.1 (2017-01-13 06:42), 0.1.5 (2020-12-15 23:30)
Other packages that cited sparkwarc R package
View sparkwarc citation profile
Other R packages that sparkwarc depends, imports, suggests or enhances
Complete documentation for sparkwarc
Functions, R codes and Examples using the sparkwarc R package
Some associated functions: cc_warc . rcpp_read_warc_sample . spark_rcpp_read_warc . spark_read_warc . spark_read_warc_sample . spark_warc_sample_path . sparkwarc . 
Some associated R codes: RcppExports.R . commoncrawl.R . dependencies.R . package.R . sample.R . sparkwarc.R .  Full sparkwarc package functions and examples
Downloads during the last 30 days
Get rewarded with contribution points by helping add
Reviews / comments / questions /suggestions ↴↴↴

Today's Hot Picks in Authors and Packages

robregcc  
Robust Regression with Compositional Covariates
We implement the algorithm estimating the parameters of the robust regression model with composition ...
Download / Learn more Package Citations See dependency  
nextGenShinyApps  
Craft Exceptional 'R Shiny' Applications and Dashboards with Novel Responsive Tools
Nove responsive tools for designing and developing 'Shiny' dashboards and applications. The scripts ...
Download / Learn more Package Citations See dependency  
con2aqi  
Calculate the AQI from Pollutant Concentration
To calculate the AQI (Air Quality Index) from pollutant concentration data. O3, PM2.5, PM10, CO, SO ...
Download / Learn more Package Citations See dependency  
bacondecomp  
Goodman-Bacon Decomposition
Decomposition for differences-in-differences with variation in treatment timing from Goodman-Bacon ...
Download / Learn more Package Citations See dependency  

23,092

R Packages

198,677

Dependencies

62,675

Author Associations

23,089

Publication Badges

© Copyright 2022 - present. All right reserved, rpkg.net.  Based in Cambridge, Massachusetts, USA