Skip to content

Upcoming breaking changes in loo_compare() output#3

Merged
chjackson merged 4 commits into
chjackson:masterfrom
florence-bockting:fix-loo_compare
Apr 24, 2026
Merged

Upcoming breaking changes in loo_compare() output#3
chjackson merged 4 commits into
chjackson:masterfrom
florence-bockting:fix-loo_compare

Conversation

@florence-bockting
Copy link
Copy Markdown

Description

In the loo package, we are making changes to the output structure returned by loo_compare() in PR #300. The main changes are a transition from a matrix to a data frame and the addition of several new columns. Here is an example of the updated output structure:

> loo_compare(w1, w2)
  model elpd_diff se_diff p_worse diag_diff diag_elpd
 model1       0.0     0.0      NA                    
 model2      -4.1     0.1    1.00   N < 100     
     
Diagnostic flags present.
See ?`loo-glossary` (sections `diag_diff` and `diag_elpd`)
or https://mc-stan.org/loo/reference/loo-glossary.html.

More context on the motivation behind these changes can be found in the updated case study "Uncertainty in Bayesian LOO-CV Model Comparison".

A reverse dependency check revealed that these changes will affect your package. To help smooth the transition, I have already reviewed your code and suggest within this PR changes that should keep your package compatible with both the current and the upcoming loo_compare() output structure.

I may have missed some additional spots in your code that need updating, so please feel free to point those out and I am happy to help. Thank you and please do not hesitate to reach out if you have any questions or concerns.

@florence-bockting florence-bockting marked this pull request as ready for review April 22, 2026 07:51
@chjackson chjackson merged commit 359dc71 into chjackson:master Apr 24, 2026
@chjackson
Copy link
Copy Markdown
Owner

Many thanks for this - the update should appear on CRAN shortly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants