AutoScore-Ordinal: An interpretable machine learning framework for generating scoring models for ordinal outcomes

by   Seyed Ehsan Saffari, et al.

Background: Risk prediction models are useful tools in clinical decision-making which help with risk stratification and resource allocations and may lead to a better health care for patients. AutoScore is a machine learning-based automatic clinical score generator for binary outcomes. This study aims to expand the AutoScore framework to provide a tool for interpretable risk prediction for ordinal outcomes. Methods: The AutoScore-Ordinal framework is generated using the same 6 modules of the original AutoScore algorithm including variable ranking, variable transformation, score derivation (from proportional odds models), model selection, score fine-tuning, and model evaluation. To illustrate the AutoScore-Ordinal performance, the method was conducted on electronic health records data from the emergency department at Singapore General Hospital over 2008 to 2017. The model was trained on 70 tested on the remaining 20 cases, where the distribution of the ordinal outcome was 80.7 30-day readmission, 12.5 inpatient or by day 30 post discharge. Two point-based risk prediction models were developed using two sets of 8 predictor variables identified by the flexible variable selection procedure. The two models indicated reasonably good performance measured by mean area under the receiver operating characteristic curve (0.785 and 0.793) and generalized c-index (0.737 and 0.760), which were comparable to alternative models. Conclusion: AutoScore-Ordinal provides an automated and easy-to-use framework for development and validation of risk prediction models for ordinal outcomes, which can systematically identify potential predictors from high-dimensional data.


The leap to ordinal: functional prognosis after traumatic brain injury using artificial intelligence

When a patient is admitted to the intensive care unit (ICU) after a trau...

AutoScore-Survival: Developing interpretable machine learning-based time-to-event scores with right-censored survival data

Scoring systems are highly interpretable and widely used to evaluate tim...

A scalable approach for developing clinical risk prediction applications in different hospitals

Objective: Machine learning algorithms are now widely used in predicting...

Directed Acyclic Graphs and causal thinking in clinical risk prediction modeling

Background: In epidemiology, causal inference and prediction modeling me...

AutoScore-Imbalance: An interpretable machine learning tool for development of clinical scores with rare events data

Background: Medical decision-making impacts both individual and public h...

The Consequences of the Framing of Machine Learning Risk Prediction Models: Evaluation of Sepsis in General Wards

Objectives: To evaluate the consequences of the framing of machine learn...

Please sign up or login with your details

Forgot password? Click here to reset