Package: dsos 0.1.2
dsos: Dataset Shift with Outlier Scores
Test for no adverse shift in two-sample comparison when we have a training set, the reference distribution, and a test set. The approach is flexible and relies on a robust and powerful test statistic, the weighted AUC. Technical details are in Kamulete, V. M. (2021) <arxiv:1908.04000>. Modern notions of outlyingness such as trust scores and prediction uncertainty can be used as the underlying scores for example.
Authors:
dsos_0.1.2.tar.gz
dsos_0.1.2.zip(r-4.5)dsos_0.1.2.zip(r-4.4)dsos_0.1.2.zip(r-4.3)
dsos_0.1.2.tgz(r-4.4-any)dsos_0.1.2.tgz(r-4.3-any)
dsos_0.1.2.tar.gz(r-4.5-noble)dsos_0.1.2.tar.gz(r-4.4-noble)
dsos_0.1.2.tgz(r-4.4-emscripten)dsos_0.1.2.tgz(r-4.3-emscripten)
dsos.pdf |dsos.html✨
dsos/json (API)
NEWS
# Install 'dsos' in R: |
install.packages('dsos', repos = c('https://vathymut.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/vathymut/dsos/issues
data-driftdata-validationdataset-shiftsdrift-detectionmachine-learningmlopsmodel-monitoringmodel-validationperformance-monitoringstatistical-process-controlstatistical-tests
Last updated 2 years agofrom:53c8e7bb5e. Checks:OK: 7. Indexed: yes.
Target | Result | Date |
---|---|---|
Doc / Vignettes | OK | Nov 10 2024 |
R-4.5-win | OK | Nov 10 2024 |
R-4.5-linux | OK | Nov 10 2024 |
R-4.4-win | OK | Nov 10 2024 |
R-4.4-mac | OK | Nov 10 2024 |
R-4.3-win | OK | Nov 10 2024 |
R-4.3-mac | OK | Nov 10 2024 |
Exports:as_bfas_pvalueat_from_osat_oobbf_comparebf_from_ospt_from_ospt_oobpt_refitwauc_from_os
Dependencies:clicodetoolscolorspacedata.tabledigestfansifarverfuturefuture.applyggplot2globalsgluegtableisobandlabelinglatticelifecyclelistenvmagrittrMASSMatrixmgcvmunsellnlmeparallellypillarpkgconfigR6RColorBrewerrlangscalessimctesttibbleutf8vctrsviridisLitewithr
A 10-minute Crash Course
Rendered frommotivation.Rmd
usingknitr::rmarkdown
on Nov 10 2024.Last update: 2023-02-19
Started: 2021-11-21
Acknowledgements
Rendered fromdependencies.Rmd
usingknitr::rmarkdown
on Nov 10 2024.Last update: 2023-02-19
Started: 2021-11-21
Bring Your Own Scores
Rendered fromdiy-score.Rmd
usingknitr::rmarkdown
on Nov 10 2024.Last update: 2023-02-19
Started: 2021-11-21
Readme and manuals
Help Manual
Help page | Topics |
---|---|
Convert P-value to Bayes Factor | as_bf |
Convert Bayes Factor to P-value | as_pvalue |
Asymptotic Test from Outlier Scores | at_from_os |
Asymptotic Test With Out-Of-Bag Scores | at_oob |
Bayesian and Frequentist Test from Outlier Scores | bf_compare |
Bayesian Test from Outlier Scores | bf_from_os |
Plot Bayesian test for no adverse shift. | plot.outlier.bayes |
Plot frequentist test for no adverse shift. | plot.outlier.test |
Print Bayesian test for no adverse shift. | print.outlier.bayes |
Print frequentist test for no adverse shift. | print.outlier.test |
Permutation Test from Outlier Scores | pt_from_os |
Permutation Test With Out-Of-Bag Scores | pt_oob |
Permutation Test By Refitting | pt_refit |
Weighted AUC from Outlier Scores | wauc_from_os |