Table 1 Comparison on progressive permutation results produced by multiple simulated data sets with different simulation parameters, including correlation \(\rho\), number of significant variables (nsv), group mean difference (\(m_1-m_2\)), and dispersion \(\kappa\)
\(\rho\) | nsv | \(m_1-m_2\) | \(\kappa\) | AOI | AUMC | \({\mathrm {slope}}_0\) | \({\mathrm {slope}}_1\) | Fragility | \({\mathrm {select}}_0\) | \({\mathrm {select}}_1\) |
|---|---|---|---|---|---|---|---|---|---|---|
0.5 | 30 | 9 | 24 | 0.30 | 0.23 | 0 | − 0.54 | 6.64 | 30 | 30 |
9 | 1 | 0.30 | 0.20 | 0 | − 0.54 | 5.74 | 30 | 30 | ||
4 | 24 | 0.30 | 0.18 | 0 | − 0.52 | 5.96 | 30 | 30 | ||
4 | 1 | − 0.05 | − 0.05 | 0.45 | 0 | 1.44 | 5 | 3 | ||
0 | 24 | 0.00 | − 0.02 | 0 | 0.1 | 0.44 | 0 | 0 | ||
0 | 1 | 0.00 | − 0.02 | 0 | 0.1 | 0.46 | 0 | 0 | ||
90 | 9 | 24 | 1.00 | 0.67 | 0 | − 2 | 11.02 | 100 | 100 | |
9 | 1 | 1.00 | 0.58 | 0 | − 1.98 | 10.14 | 100 | 100 | ||
4 | 24 | 0.89 | 0.44 | − 0.6 | − 1.74 | 8.84 | 89 | 84 | ||
4 | 1 | − 0.08 | − 0.08 | 1.5 | − 0.08 | 2.06 | 8 | 3 | ||
0 | 24 | 0.00 | − 0.02 | 0 | 0.1 | 0.34 | 0 | 0 | ||
0 | 1 | 0.00 | − 0.02 | 0 | 0.1 | 0.5 | 0 | 0 | ||
0.8 | 30 | 9 | 24 | 0.30 | 0.23 | 0 | − 0.54 | 6.58 | 30 | 30 |
9 | 1 | 0.30 | 0.20 | 0 | − 0.54 | 5.8 | 30 | 30 | ||
4 | 24 | 0.30 | 0.18 | 0 | − 0.52 | 5.14 | 30 | 30 | ||
4 | 1 | 0.04 | 0.04 | − 0.45 | 0.02 | 1.2 | 4 | 0 | ||
0 | 24 | 0.00 | − 0.02 | 0 | 0.1 | 0.66 | 0 | 0 | ||
0 | 1 | 0.00 | − 0.02 | 0 | 0.1 | 0.3 | 0 | 0 | ||
90 | 9 | 24 | 1.00 | 0.67 | 0 | − 2 | 11.12 | 100 | 100 | |
9 | 1 | 1.00 | 0.58 | 0 | − 1.98 | 10.1 | 100 | 100 | ||
4 | 24 | 0.97 | 0.45 | − 2.1 | − 1.9 | 8.82 | 97 | 87 | ||
4 | 1 | − 0.07 | − 0.08 | 2.25 | − 0.04 | 2.06 | 7 | 0 | ||
0 | 24 | 0.00 | − 0.02 | 0 | 0.08 | 0.54 | 0 | 0 | ||
0 | 1 | 0.00 | − 0.02 | 0 | 0.1 | 0.2 | 0 | 0 |