This analysis shows how different positive fraction values affect the key reliability metrics. Results are computed with N=12 reviewers, M=6 queues, K=10,000 data points, Simulated Accuracy=0.96, accuracy variance=0.03, with 20 iterations per data point.
Running analysis for positive fraction: 0.02
Impact of Positive Fraction on Reliability Metrics
Metrics vs. Positive Fraction
Inter-Rater Kappa vs. Positive Fraction
Rater Accuracy vs. Positive Fraction
Inter-Queue Kappa vs. Positive Fraction
Queue Accuracy vs. Positive Fraction
Alignment Rate vs. Positive Fraction
Detailed Results
Positive Fraction
Inter-Rater Kappa
Rater Accuracy
Inter-Queue Kappa
Queue Accuracy
Alignment Rate
Simulated Accuracy Impact Analysis
This analysis shows how different Simulated Accuracy values affect the key reliability metrics. Results are computed with N=9 reviewers, M=3 queues, K=2,000 data points, positive fraction=0.1, accuracy variance=0.03, with 20 iterations per data point.
Preparing analysis...
Impact of Simulated Accuracy on Reliability Metrics
Metrics vs. Simulated Accuracy
Inter-Rater Kappa vs. Simulated Accuracy
Rater Accuracy vs. Simulated Accuracy
Inter-Queue Kappa vs. Simulated Accuracy
Queue Accuracy vs. Simulated Accuracy
Alignment Rate vs. Simulated Accuracy
STDDEV Prevalence vs. Simulated Accuracy
Relationship Analysis: Agreement Measures vs. Prevalence Variance