# Backtest: DR artist × channel × week Panel: 3246 artists × 14 channels × 51 complete weeks (2025-11-17 to 2026-11-02). Forecast origins from week 27; regressions refitted every 2 origin(s). "In rotation" = at least τ plays in the week: p3 23, p4kbh 15, p4sjaelland 14, p4fyn 14, p4syd 14, p4trekanten 14, p4vest 13, p4aarhus 14, p4nord 15, p4bornholm 14, p4esbjerg 14, p5 10, p6beat 16, p8jazz 7. ## h = 1 week(s) ahead (24 forecast weeks) | Model | Log-loss, all | Log-loss, adds | Brier, adds | PR-AUC, adds | MAE plays | Spearman | NDCG@50 | |---|---|---|---|---|---|---|---| | persistence | 0.0217 | 0.0159 | 0.0023 | 0.003 | 0.27 | 0.826 | 0.967 | | popularity | 0.0216 | 0.0110 | 0.0028 | 0.170 | 0.31 | 0.864 | 0.886 | | kalman | 0.0156 | 0.0088 | 0.0019 | 0.316 | 0.30 | 0.872 | 0.951 | | nb | 0.0131 | 0.0080 | 0.0017 | 0.330 | 0.27 | 0.856 | 0.960 | | logit | 0.0113 | 0.0066 | 0.0017 | 0.359 | 0.27 | 0.856 | 0.960 | Skill on adds (1 − log-loss ÷ baseline log-loss; 90% block-bootstrap interval over weeks): | Model | vs persistence | vs popularity | |---|---|---| | kalman | 0.447 (0.376 to 0.510) | 0.204 (0.136 to 0.266) | | nb | 0.497 (0.439 to 0.550) | 0.274 (0.204 to 0.337) | | logit | 0.582 (0.554 to 0.614) | 0.398 (0.368 to 0.436) | Calibration of the NB's add probabilities (rows not in rotation at the origin): | Predicted | Rows | Mean predicted | Observed | |---|---|---|---| | 0.0–0.1 | 1067535 | 0.000 | 0.001 | | 0.1–0.2 | 2694 | 0.146 | 0.129 | | 0.2–0.3 | 1559 | 0.247 | 0.246 | | 0.3–0.4 | 1113 | 0.347 | 0.340 | | 0.4–0.5 | 697 | 0.449 | 0.420 | | 0.5–0.6 | 444 | 0.543 | 0.482 | | 0.6–0.7 | 212 | 0.649 | 0.448 | | 0.7–0.8 | 96 | 0.740 | 0.417 | | 0.8–0.9 | 63 | 0.840 | 0.508 | | 0.9–1.0 | 19 | 0.950 | 0.421 | ## h = 4 week(s) ahead (21 forecast weeks) | Model | Log-loss, all | Log-loss, adds | Brier, adds | PR-AUC, adds | MAE plays | Spearman | NDCG@50 | |---|---|---|---|---|---|---|---| | persistence | 0.0318 | 0.0242 | 0.0037 | 0.005 | 0.33 | 0.811 | 0.907 | | popularity | 0.0284 | 0.0168 | 0.0039 | 0.145 | 0.36 | 0.845 | 0.829 | | kalman | 0.0283 | 0.0196 | 0.0033 | 0.227 | 0.39 | 0.850 | 0.887 | | nb | 0.0257 | 0.0186 | 0.0031 | 0.251 | 0.34 | 0.835 | 0.898 | | logit | 0.0198 | 0.0127 | 0.0029 | 0.298 | 0.34 | 0.835 | 0.898 | Skill on adds (1 − log-loss ÷ baseline log-loss; 90% block-bootstrap interval over weeks): | Model | vs persistence | vs popularity | |---|---|---| | kalman | 0.191 (0.046 to 0.325) | -0.170 (-0.329 to -0.038) | | nb | 0.235 (0.093 to 0.362) | -0.107 (-0.283 to 0.030) | | logit | 0.477 (0.420 to 0.536) | 0.244 (0.175 to 0.293) | Calibration of the NB's add probabilities (rows not in rotation at the origin): | Predicted | Rows | Mean predicted | Observed | |---|---|---|---| | 0.0–0.1 | 931278 | 0.001 | 0.002 | | 0.1–0.2 | 3415 | 0.143 | 0.094 | | 0.2–0.3 | 2051 | 0.247 | 0.207 | | 0.3–0.4 | 1566 | 0.348 | 0.287 | | 0.4–0.5 | 1010 | 0.444 | 0.413 | | 0.5–0.6 | 528 | 0.545 | 0.443 | | 0.6–0.7 | 235 | 0.641 | 0.306 | | 0.7–0.8 | 94 | 0.748 | 0.521 | | 0.8–0.9 | 35 | 0.839 | 0.457 | | 0.9–1.0 | 3 | 0.927 | 0.000 | ## h = 8 week(s) ahead (17 forecast weeks) | Model | Log-loss, all | Log-loss, adds | Brier, adds | PR-AUC, adds | MAE plays | Spearman | NDCG@50 | |---|---|---|---|---|---|---|---| | persistence | 0.0433 | 0.0344 | 0.0055 | 0.007 | 0.40 | 0.783 | 0.833 | | popularity | 0.0359 | 0.0241 | 0.0052 | 0.152 | 0.40 | 0.823 | 0.777 | | kalman | 0.0427 | 0.0330 | 0.0050 | 0.195 | 0.51 | 0.821 | 0.816 | | nb | 0.0418 | 0.0330 | 0.0048 | 0.233 | 0.43 | 0.804 | 0.812 | | logit | 0.0301 | 0.0208 | 0.0046 | 0.280 | 0.43 | 0.804 | 0.812 | Skill on adds (1 − log-loss ÷ baseline log-loss; 90% block-bootstrap interval over weeks): | Model | vs persistence | vs popularity | |---|---|---| | kalman | 0.040 (-0.078 to 0.167) | -0.367 (-0.490 to -0.223) | | nb | 0.042 (-0.097 to 0.159) | -0.365 (-0.522 to -0.228) | | logit | 0.394 (0.348 to 0.433) | 0.137 (0.089 to 0.173) | Calibration of the NB's add probabilities (rows not in rotation at the origin): | Predicted | Rows | Mean predicted | Observed | |---|---|---|---| | 0.0–0.1 | 751167 | 0.001 | 0.003 | | 0.1–0.2 | 4090 | 0.145 | 0.084 | | 0.2–0.3 | 2546 | 0.248 | 0.209 | | 0.3–0.4 | 1673 | 0.348 | 0.289 | | 0.4–0.5 | 976 | 0.443 | 0.416 | | 0.5–0.6 | 429 | 0.544 | 0.445 | | 0.6–0.7 | 208 | 0.646 | 0.409 | | 0.7–0.8 | 76 | 0.740 | 0.434 | | 0.8–0.9 | 25 | 0.828 | 0.880 | ## NB coefficients, h = 4, all weeks (alpha = 0.134) | Feature | Coefficient | |---|---| | intercept | -0.787 | | log plays t | +0.313 | | log plays t-1 | +0.140 | | log mean plays 4w | +0.480 | | log mean plays 12w | -0.057 | | log max plays 12w | +0.368 | | log other channels t | -0.018 | | log other channels 4w | +0.044 | | log P3 t | +0.014 | | weeks since played (/12) | -3.164 | | Track Top-40 score | -0.021 | | Airplay Top-20 score | -0.418 | | chart entry recency 6w | +0.539 | | chart entry recency 26w | -0.383 | | log Track Top-40 hits | +0.032 | | log Airplay Top-20 hits | +0.005 | | Danish | -0.007 | | group | -0.053 | | female | +0.021 | | career years (/50) | -0.229 | | debut unknown | -0.059 | | Christmas target week | +0.000 | | Danish x P3 | -0.001 | | Danish x P4 | +0.020 | | Danish x P6 | +0.007 | | ch p4kbh | -0.013 | | ch p4sjaelland | -0.009 | | ch p4fyn | -0.015 | | ch p4syd | -0.010 | | ch p4trekanten | -0.012 | | ch p4vest | -0.010 | | ch p4aarhus | -0.010 | | ch p4nord | -0.007 | | ch p4bornholm | -0.013 | | ch p4esbjerg | -0.011 | | ch p5 | +0.118 | | ch p6beat | +0.066 | | ch p8jazz | +0.103 |