Skip to contents

performance 0.9.1

CRAN release: 2022-06-20

Breaking

  • The formerly “conditional” ICC in icc() is now named “unadjusted” ICC.

New functions

Support for new models

  • Added support for models from package estimator.

Changes to functions

Bug fixes

  • check_predictions() did not work for GLMs with matrix-response.

  • check_predictions() did not work for logistic regression models (i.e.  models with binary response) from package glmmTMB

  • item_split_half() did not work when the input data frame or matrix only contained two columns.

  • Fixed wrong computation of BIC in model_performance() when models had transformed response values.

  • Fixed issues in check_model() for GLMs with matrix-response.

performance 0.9.0

CRAN release: 2022-03-30

New functions

  • check_concurvity(), which returns GAM concurvity measures (comparable to collinearity checks).

Changes to functions

Check functions

Test functions

Model performance functions

  • performance_aic() now corrects the AIC value for models with transformed response variables. This also means that comparing models using compare_performance() allows comparisons of AIC values for models with and without transformed response variables.

  • Also, model_performance() now corrects both AIC and BIC values for models with transformed response variables.

Plotting and printing

  • The print() method for binned_residuals() now prints a short summary of the results (and no longer generates a plot). A plot() method was added to generate plots.

  • The plot() output for check_model() was revised:

    • For binomial models, the constant variance plot was omitted, and a binned residuals plot included.

    • The density-plot that showed normality of residuals was replaced by the posterior predictive check plot.

Bug fixes

performance 0.8.0

CRAN release: 2021-10-01

Breaking Changes

  • The ci-level in r2() for Bayesian models now defaults to 0.95, to be in line with the latest changes in the bayestestR package.

  • S3-method dispatch for pp_check() was revised, to avoid problems with the bayesplot package, where the generic is located.

General

New functions

Changes to functions

  • r2() for linear models can now compute confidence intervals, via the ci argument.

Bug fixes

  • Fixed issues in check_model() for Bayesian models.

  • Fixed issue in pp_check() for models with transformed response variables, so now predictions and observed response values are on the same (transformed) scale.

performance 0.7.3

CRAN release: 2021-07-21

Changes to functions

performance 0.7.2

CRAN release: 2021-05-17

New functions

Bug fixes

  • Fixed issue with "data length differs from size of matrix" warnings in examples in forthcoming R 4.2.

  • Fixed issue in check_normality() for models with sample size larger than 5.000 observations.

  • Fixed issue in check_model() for glmmTMB models.

  • Fixed issue in check_collinearity() for glmmTMB models with zero-inflation, where the zero-inflated model was an intercept-only model.

performance 0.7.1

CRAN release: 2021-04-09

New supported models

  • Add support for model_fit (tidymodels).

  • model_performance supports kmeans models.

General

  • Give more informative warning when r2_bayes() for BFBayesFactor objects can’t be calculated.

  • Several check_*() functions now return informative messages for invalid model types as input.

  • r2() supports mhurdle (mhurdle) models.

  • Added print() methods for more classes of r2().

  • The performance_roc() and performance_accuracy() functions unfortunately had spelling mistakes in the output columns: Sensitivity was called Sensivity and Specificity was called Specifity. We think these are understandable mistakes :-)

Changes to functions

check_model()

model_performance()

Other functions

  • The default-method for r2() now tries to compute an r-squared for all models that have no specific r2()-method yet, by using following formula: 1-sum((y-y_hat)^2)/sum((y-y_bar)^2))

  • The column name Parameter in check_collinearity() is now more appropriately named Term.

Bug fixes

  • test_likelihoodratio() now correctly sorts models with identical fixed effects part, but different other model parts (like zero-inflation).

  • Fixed incorrect computation of models from inverse-Gaussian families, or Gaussian families fitted with glm().

  • Fixed issue in performance_roc() for models where outcome was not 0/1 coded.

  • Fixed issue in performance_accuracy() for logistic regression models when method = "boot".

  • cronbachs_alpha() did not work for matrix-objects, as stated in the docs. It now does.

performance 0.7.0

CRAN release: 2021-02-03

General

  • Roll-back R dependency to R >= 3.4.

Breaking Changes

New functions to test or compare models

Changes to functions

performance_lrt()

  • performance_lrt() get an alias test_likelihoodratio().

  • Does not return AIC/BIC now (as they are not related to LRT per se and can be easily obtained with other functions).

  • Now contains a column with the difference in degrees of freedom between models.

  • Fixed column names for consistency.

model_performance()

  • Added more diagnostics to models of class ivreg.

Other functions

Bug fixes

performance 0.6.1

CRAN release: 2020-12-09

General

Bug fixes

  • Fixed examples, now using suggested packages only conditionally.

performance 0.6.0

CRAN release: 2020-12-01

General

New functions

  • r2_somers(), to compute Somers’ Dxy rank-correlation as R2-measure for logistic regression models.

  • display(), to print output from package-functions into different formats. print_md() is an alias for display(format = "markdown").

Changes to functions

model_performance()

  • model_performance() is now more robust and doesn’t fail if an index could not be computed. Instead, it returns all indices that were possible to calculate.

  • model_performance() gains a default-method that catches all model objects not previously supported. If model object is also not supported by the default-method, a warning is given.

  • model_performance() for metafor-models now includes the degrees of freedom for Cochran’s Q.

Other functions

  • performance_mse() and performance_rmse() now always try to return the (R)MSE on the response scale.

  • performance_accuracy() now accepts all types of linear or logistic regression models, even if these are not of class lm or glm.

  • performance_roc() now accepts all types of logistic regression models, even if these are not of class glm.

  • r2() for mixed models and r2_nakagawa() gain a tolerance-argument, to set the tolerance level for singularity checks when computing random effect variances for the conditional r-squared.

Bug fixes

  • Fixed issue in icc() introduced in the last update that make lme-models fail.

  • Fixed issue in performance_roc() for models with factors as response.

performance 0.5.1

CRAN release: 2020-10-29

Breaking changes

  • Column names for model_performance() and compare_performance() were changed to be in line with the easystats naming convention: LOGLOSS is now Log_loss, SCORE_LOG is Score_log and SCORE_SPHERICAL is now Score_spherical.

New functions

  • r2_posterior() for Bayesian models to obtain posterior distributions of R-squared.

Changes to functions

Bug fixes

  • Fix bug in compare_performance() when ... arguments were function calls to regression objects, instead of direct function calls.

performance 0.5.0

CRAN release: 2020-09-12

General

New functions

  • pp_check() to compute posterior predictive checks for frequentist models.

Bug fixes

performance 0.4.8

CRAN release: 2020-07-27

General

  • Removed suggested packages that have been removed from CRAN.

Changes to functions

  • icc() now also computes a “classical” ICC for brmsfit models. The former way of calculating an “ICC” for brmsfit models is now available as new function called variance_decomposition().

Bug fixes

performance 0.4.7

CRAN release: 2020-06-14

General

  • Support for models from package mfx.

Changes to functions

  • model_performance.rma() now includes results from heterogeneity test for meta-analysis objects.

  • check_normality() now also works for mixed models (with the limitation that studentized residuals are used).

  • check_normality() gets an effects-argument for mixed models, to check random effects for normality.

Bug fixes

performance 0.4.6

CRAN release: 2020-05-03

General

  • Minor revisions to model_performance() to meet changes in mlogit package.

  • Support for bayesx models.

Changes to functions

  • icc() gains a by_group argument, to compute ICCs per different group factors in mixed models with multiple levels or cross-classified design.

  • r2_nakagawa() gains a by_group argument, to compute explained variance at different levels (following the variance-reduction approach by Hox 2010).

  • performance_lrt() now works on lavaan objects.

Bug fixes

  • Fix issues in some functions for models with logical dependent variable.

  • Fix bug in check_itemscale(), which caused multiple computations of skewness statistics.

  • Fix issues in r2() for gam models.

performance 0.4.5

CRAN release: 2020-03-28

General

Changes to functions

  • compare_performance() gets a bayesfactor argument, to include or exclude the Bayes factor for model comparisons in the output.

  • Added r2.aov().

Bug fixes