Other packages > Find by keyword >

Explore topics

By keyword . Oldest R packages . Newest R packages . Top downloaded R packages . Datasets . Archived R packages . Top downloaded last week . Top downloaded yesterday

planningML

Star Watch Copy Code

A Sample Size Calculator for Machine Learning Applications in Healthcare

View on CRAN: Click here

Download and install planningML package within the R console
Install from CRAN:

 install.packages("planningML")

Install from Github:

 library("remotes")

                        install_github("cran/planningML")

Install by package version:

 library("remotes")

                        install_version("planningML", "1.0.1")

Attach the package and use:

 library("planningML")

Maintained by
Xinying Fang
[Scholar Profile | Author Map]

All associated links for this package

First Published: 2022-11-08

Latest Update: 2023-06-23

Description:

Advances in automated document classification has led to identifying massive numbers of clinical concepts from handwritten clinical notes. These high dimensional clinical concepts can serve as highly informative predictors in building classification algorithms for identifying patients with different clinical conditions, commonly referred to as patient phenotyping. However, from a planning perspective, it is critical to ensure that enough data is available for the phenotyping algorithm to obtain a desired classification performance. This challenge in sample size planning is further exacerbated by the high dimension of the feature space and the inherent imbalance of the response class. Currently available sample size planning methods can be categorized into: (i) model-based approaches that predict the sample size required for achieving a desired accuracy using a linear machine learning classifier and (ii) learning curve-based approaches (Figueroa et al. (2012) ) that fit an inverse power law curve to pilot data to extrapolate performance. We develop model-based approaches for imbalanced data with correlated features, deriving sample size formulas for performance metrics that are sensitive to class imbalance such as Area Under the receiver operating characteristic Curve (AUC) and Matthews Correlation Coefficient (MCC). This is done using a two-step approach where we first perform feature selection using the innovated High Criticism thresholding method (Hall and Jin (2010) ), then determine the sample size by optimizing the two performance metrics. Further, we develop software in the form of an R package named 'planningML' and an 'R' 'Shiny' app to facilitate the convenient implementation of the developed model-based approaches and learning curve approaches for imbalanced data. We apply our methods to the problem of phenotyping rare outcomes using the MIMIC-III electronic health record database. We show that our developed methods which relate training data size and performance on AUC and MCC, can predict the true or observed performance from linear ML classifiers such as LASSO and SVM at different training data sizes. Therefore, in high-dimensional classification analysis with imbalanced data and correlated features, our approach can efficiently and accurately determine the sample size needed for machine-learning based classification.

How to cite:

Xinying Fang (2022). planningML: A Sample Size Calculator for Machine Learning Applications in Healthcare. R package version 1.0.1, https://cran.r-project.org/web/packages/planningML. Accessed 05 Mar. 2026.

Previous versions and publish date:

1.0.0 (2022-11-08 11:20), 1.0.1 (2023-06-23 07:40)

Other packages that cited planningML R package

View planningML citation profile

Other R packages that planningML depends, imports, suggests or enhances

View planningML dependency map

Complete documentation for planningML

View documentation PDF

Functions, R codes and Examples using the planningML R package

Some associated functions: featureselection . fit_learningcurve . learningcurve_data . plot.planningML . samplesize . summary.planningML .
Some associated R codes: calculate_PCC_by_DS_Updated.R . featureselection.R . fit_learningcurve.R . learningcurve_data.R . plot.planningML.R . samplesize.R . summary.planningML.R . Full planningML package functions and examples

Downloads during the last 30 days

Today's Hot Picks in Authors and Packages

roccv

ROC for Cross Validation Results

Cross validate large genetic data while specifying clinical variables that should always be in the m ...
Download / Learn more Package Citations See dependency

Maintainer: Ben Sherwood (view profile)

ClimClass

Climate Classification According to Several Indices

Classification of climate according to Koeppen - Geiger, of aridity indices, of continentality indi ...
Download / Learn more Package Citations See dependency

Maintainer: Emanuele Eccel (view profile)

imagefx

Extract Features from Images

Synthesize images into characteristic features for time-series analysis or machine learning applicat ...
Download / Learn more Package Citations See dependency

Maintainer: Alex J.C. Witsil (view profile)

neat

Efficient Network Enrichment Analysis Test

Includes functions and examples to compute NEAT, the Network Enrichment Analysis Test described in ...
Download / Learn more Package Citations See dependency

Maintainer: Mirko Signorelli (view profile)

diffIRT

Diffusion IRT Models for Response and Response Time Data

Package to fit diffusion-based IRT models to response and response time data. Models are fit using ...
Download / Learn more Package Citations See dependency

Maintainer: Dylan Molenaar (view profile)

nextGenShinyApps

Craft Exceptional 'R Shiny' Applications and Dashboards with Novel Responsive Tools

Nove responsive tools for designing and developing 'Shiny' dashboards and applications. The scripts ...
Download / Learn more Package Citations See dependency

Maintainer: Obinna Obianom (view profile)