rhoR

Rho for Inter Rater Reliability

Rho is used to test the generalization of inter rater reliability (IRR) statistics. Calculating rho starts by generating a large number of simulated, fully-coded data sets: a sizable collection of hypothetical populations, all of which have a kappa value below a given threshold -- which indicates unacceptable agreement. Then kappa is calculated on a sample from each of those sets in the collection to see if it is equal to or higher than the kappa in then real sample. If less than five percent of the distribution of samples from the simulated data sets is greater than actual observed kappa, the null hypothesis is rejected and one can conclude that if the two raters had coded the rest of the data, we would have acceptable agreement (kappa above the threshold).

5,816

936

84

31

Description file content

Package
rhoR
Title
Rho for Inter Rater Reliability
Maintainer
Cody L Marquart
Version
1.2.1.1
Description
Rho is used to test the generalization of inter rater reliability (IRR) statistics. Calculating rho starts by generating a large number of simulated, fully-coded data sets: a sizable collection of hypothetical populations, all of which have a kappa value below a given threshold -- which indicates unacceptable agreement. Then kappa is calculated on a sample from each of those sets in the collection to see if it is equal to or higher than the kappa in then real sample. If less than five percent of the distribution of samples from the simulated data sets is greater than actual observed kappa, the null hypothesis is rejected and one can conclude that if the two raters had coded the rest of the data, we would have acceptable agreement (kappa above the threshold).
Depends
R (>= 3.0.0)
LazyData
true
RoxygenNote
6.1.0
Suggests
testthat
Collate
'rhoR.R' 'rho.R' 'rhoK.R' 'rhoSet.R' 'rhoCT.R' 'kappa.R' 'kappaSet.R' 'kappaCT.R' 'rhoMin.R' 'baserate.R' 'baserateSet.R' 'baserateCT.R' 'calcKappa.R' 'calcRho.R' 'checkBRPKcombo.R' 'contingencyTable.R' 'codeSet.R' 'contingencyToSet.R' 'createRandomSet.R' 'createSimulatedCodeSet.R' 'genPKcombo.R' 'genPcombo.R' 'generateKPs.R' 'getBootPvalue.R' 'getHandSet.R' 'getHandSetIndices.R' 'getR.R' 'getTestSet.R' 'prset.R'
NeedsCompilation
no
Packaged
2019-04-01 02:58:05 UTC; root
Author
Brendan Eagan [aut], Brad Rogers [aut], Rebecca Pozen [aut], Cody L Marquart [cre, aut], David Williamson Shaffer [aut]
Repository
CRAN
Date/Publication
2019-04-01 04:40:09 UTC

`install.packages('rhoR')`

1.2.1.1

2 months ago

Cody L Marquart