Skip to content

Commit 64b365c

Browse files
committed
improved loo_compare documentation
1 parent 846a891 commit 64b365c

1 file changed

Lines changed: 12 additions & 7 deletions

File tree

R/loo_compare.R

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -39,13 +39,18 @@
3939
#' distribution, a practice derived for Gaussian linear models or
4040
#' asymptotically, and which only applies to nested models in any case.
4141
#'
42-
#' The values in the `p_worse` column are computed using the normal
43-
#' approximation and values from the columns `elpd_diff` and
44-
#' `se_diff`. Sivula et al. (2025) discuss the conditions when the
45-
#' normal approximation used for SE and `se_diff` is good, and the
46-
#' column `diag_pnorm` contains possible diagnostic messages: 1)
47-
#' small data (N < 100), 2) similar predictions (|elpd_diff| < 4),
48-
#' or 3) possible outliers (khat > 0.5).
42+
#' The values in the `p_worse` column show the probabilities for models
43+
#' having worse ELPD than the best model. These probabilities are
44+
#' computed using the normal approximation and values from the
45+
#' columns `elpd_diff` and `se_diff`. Sivula et al. (2025) present
46+
#' the conditions when the normal approximation used for SE and
47+
#' `se_diff` is good, and the column `diag_pnorm` contains possible
48+
#' diagnostic messages: 1) small data (N < 100), 2) similar
49+
#' predictions (|elpd_diff| < 4), or 3) possible outliers (khat > 0.5).
50+
#' If any of these diagnostic messages is shown, the normal
51+
#' approximation is not well calibrated and the shown probabilities
52+
#' can be too large (small data or similar predictions) or too small
53+
#' (outliers).
4954
#'
5055
#' If more than \eqn{11} models are compared, we internally recompute the model
5156
#' differences using the median model by ELPD as the baseline model. We then

0 commit comments

Comments
 (0)