Package: dsos 0.1.2
dsos: Dataset Shift with Outlier Scores
Test for no adverse shift in two-sample comparison when we have a training set, the reference distribution, and a test set. The approach is flexible and relies on a robust and powerful test statistic, the weighted AUC. Technical details are in Kamulete, V. M. (2021) <arxiv:1908.04000>. Modern notions of outlyingness such as trust scores and prediction uncertainty can be used as the underlying scores for example.
Authors:
dsos_0.1.2.tar.gz
dsos_0.1.2.zip(r-4.5)dsos_0.1.2.zip(r-4.4)dsos_0.1.2.zip(r-4.3)
dsos_0.1.2.tgz(r-4.4-any)dsos_0.1.2.tgz(r-4.3-any)
dsos_0.1.2.tar.gz(r-4.5-noble)dsos_0.1.2.tar.gz(r-4.4-noble)
dsos_0.1.2.tgz(r-4.4-emscripten)dsos_0.1.2.tgz(r-4.3-emscripten)
dsos.pdf |dsos.html✨
dsos/json (API)
NEWS
| # Install 'dsos' in R: |
| install.packages('dsos', repos = c('https://vathymut.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/vathymut/dsos/issues
data-driftdata-validationdataset-shiftsdrift-detectionmachine-learningmlopsmodel-monitoringmodel-validationperformance-monitoringstatistical-process-controlstatistical-tests
Last updated 2 years agofrom:53c8e7bb5e. Checks:OK: 7. Indexed: yes.
| Target | Result | Date |
|---|---|---|
| Doc / Vignettes | OK | Oct 11 2024 |
| R-4.5-win | OK | Oct 11 2024 |
| R-4.5-linux | OK | Oct 11 2024 |
| R-4.4-win | OK | Oct 11 2024 |
| R-4.4-mac | OK | Oct 11 2024 |
| R-4.3-win | OK | Oct 11 2024 |
| R-4.3-mac | OK | Oct 11 2024 |
Exports:as_bfas_pvalueat_from_osat_oobbf_comparebf_from_ospt_from_ospt_oobpt_refitwauc_from_os
Dependencies:clicodetoolscolorspacedata.tabledigestfansifarverfuturefuture.applyggplot2globalsgluegtableisobandlabelinglatticelifecyclelistenvmagrittrMASSMatrixmgcvmunsellnlmeparallellypillarpkgconfigR6RColorBrewerrlangscalessimctesttibbleutf8vctrsviridisLitewithr
A 10-minute Crash Course
Rendered frommotivation.Rmdusingknitr::rmarkdownon Oct 11 2024.Last update: 2023-02-19
Started: 2021-11-21
Acknowledgements
Rendered fromdependencies.Rmdusingknitr::rmarkdownon Oct 11 2024.Last update: 2023-02-19
Started: 2021-11-21
Bring Your Own Scores
Rendered fromdiy-score.Rmdusingknitr::rmarkdownon Oct 11 2024.Last update: 2023-02-19
Started: 2021-11-21
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Convert P-value to Bayes Factor | as_bf |
| Convert Bayes Factor to P-value | as_pvalue |
| Asymptotic Test from Outlier Scores | at_from_os |
| Asymptotic Test With Out-Of-Bag Scores | at_oob |
| Bayesian and Frequentist Test from Outlier Scores | bf_compare |
| Bayesian Test from Outlier Scores | bf_from_os |
| Plot Bayesian test for no adverse shift. | plot.outlier.bayes |
| Plot frequentist test for no adverse shift. | plot.outlier.test |
| Print Bayesian test for no adverse shift. | print.outlier.bayes |
| Print frequentist test for no adverse shift. | print.outlier.test |
| Permutation Test from Outlier Scores | pt_from_os |
| Permutation Test With Out-Of-Bag Scores | pt_oob |
| Permutation Test By Refitting | pt_refit |
| Weighted AUC from Outlier Scores | wauc_from_os |
