The Population Resemblance Statistic: A Chi-Square Measure of Fit for Banking

07/21/2023
by   Nelis Potgieter, et al.
0

The Population Stability Index (PSI) is a widely used measure in credit risk modeling and monitoring within the banking industry. Its purpose is to monitor for changes in the population underlying a model, such as a scorecard, to ensure that the current population closely resembles the one used during model development. If substantial differences between populations are detected, model reconstruction may be necessary. Despite its widespread use, the origins and properties of the PSI are not well documented. Previous literature has suggested using arbitrary constants as a rule-of-thumb to assess stability, regardless of sample size. However, this approach too often calls for model reconstruction in small sample sizes while not detecting the need often enough in large sample sizes. This paper introduces an alternative discrepancy measure called the Population Resemblance statistic (PRS). It is based on the Pearson chi-square statistic. Properties of the PRS follow from the non-central chi-square distribution. Notably, the PRS accommodates sample-size dependent critical values and enables the specification of risk tolerances. Its efficacy is demonstrated in a simulation study and with real-world examples.

READ FULL TEXT

page 20

page 21

research
03/02/2023

A critical review of existing and new population stability testing procedures in credit risk scoring

Credit scorecards are models used for the modelling of the probability o...
research
12/13/2017

Geometry of the sample frequency spectrum and the perils of demographic inference

The sample frequency spectrum (SFS), which describes the distribution of...
research
11/18/2021

A sample size heuristic for network scale-up studies

The network scale-up method (NSUM) is a survey-based method for estimati...
research
05/19/2019

Second Order Expansions for Sample Median with Random Sample Size

In practice, we often encounter situations where a sample size is not de...
research
09/13/2021

IQ: Intrinsic measure for quantifying the heterogeneity in meta-analysis

Quantifying the heterogeneity is an important issue in meta-analysis, an...
research
04/05/2021

ERStruct: An Eigenvalue Ratio Approach to Inferring Population Structure from Sequencing Data

Inference of population structure from genetic data plays an important r...
research
02/19/2018

Maximum value of the standardized log of odds ratio and celestial mechanics

The odds ratio (OR) is a widely used measure of the effect size in obser...

Please sign up or login with your details

Forgot password? Click here to reset