Background | Motivational example | References
Package: dsos 0.1.2
dsos: Dataset Shift with Outlier Scores
Test for no adverse shift in two-sample comparison when we have a training set, the reference distribution, and a test set. The approach is flexible and relies on a robust and powerful test statistic, the weighted AUC. Technical details are in Kamulete, V. M. (2021) <arxiv:1908.04000>. Modern notions of outlyingness such as trust scores and prediction uncertainty can be used as the underlying scores for example.
Authors:
dsos_0.1.2.tar.gz
dsos_0.1.2.zip(r-4.7-any)dsos_0.1.2.zip(r-4.6-any)dsos_0.1.2.zip(r-4.5-any)
dsos_0.1.2.tgz(r-4.6-any)dsos_0.1.2.tgz(r-4.5-any)
dsos_0.1.2.tar.gz(r-4.7-any)dsos_0.1.2.tar.gz(r-4.6-any)
dsos_0.1.2.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
dsos/json (API)
| # Install 'dsos' in R: |
| install.packages('dsos', repos = c('https://vathymut.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/vathymut/dsos/issues
data-driftdata-validationdataset-shiftsdrift-detectionmachine-learningmlopsmodel-monitoringmodel-validationperformance-monitoringstatistical-process-controlstatistical-tests
Last updated from:53c8e7bb5e. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | OK | 178 | ||
| source / vignettes | OK | 209 | ||
| linux-release | OK | 219 | ||
| macos-release | OK | 129 | ||
| macos-oldrel | OK | 169 | ||
| windows-devel | OK | 63 | ||
| windows-release | OK | 81 | ||
| windows-oldrel | OK | 76 | ||
| wasm-release | OK | 112 |
Exports:as_bfas_pvalueat_from_osat_oobbf_comparebf_from_ospt_from_ospt_oobpt_refitwauc_from_os
Dependencies:clicodetoolscpp11data.tabledigestfarverfuturefuture.applyggplot2globalsgluegtableisobandlabelinglifecyclelistenvparallellyR6RColorBrewerrlangS7scalessimctestvctrsviridisLitewithr
A 10-minute Crash Course
Last update: 2023-02-19
Started: 2021-11-21
Acknowledgements
References
Last update: 2023-02-19
Started: 2021-11-21
Bring Your Own Scores
DIY | In Action | References
Last update: 2023-02-19
Started: 2021-11-21
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Convert P-value to Bayes Factor | as_bf |
| Convert Bayes Factor to P-value | as_pvalue |
| Asymptotic Test from Outlier Scores | at_from_os |
| Asymptotic Test With Out-Of-Bag Scores | at_oob |
| Bayesian and Frequentist Test from Outlier Scores | bf_compare |
| Bayesian Test from Outlier Scores | bf_from_os |
| Plot Bayesian test for no adverse shift. | plot.outlier.bayes |
| Plot frequentist test for no adverse shift. | plot.outlier.test |
| Print Bayesian test for no adverse shift. | print.outlier.bayes |
| Print frequentist test for no adverse shift. | print.outlier.test |
| Permutation Test from Outlier Scores | pt_from_os |
| Permutation Test With Out-Of-Bag Scores | pt_oob |
| Permutation Test By Refitting | pt_refit |
| Weighted AUC from Outlier Scores | wauc_from_os |