Old DR artist pages from the Wayback Machine (53 weeks of plays per capture, 2019-2024) into dr_artist_history; leak fixes (weeks since last add counts only adds up to t-1; training windows close a week before the origin) and a leak test (model leakcheck) that rebuilds every feature from data cut at the origin; backtests split pre-release (NMF from history) and post-release (NMF known); site shows the new-song backtest
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
+46
-45
@@ -4,53 +4,54 @@ Events: an artist in the panel releases something (Deezer) in week t0+1, with no
|
||||
|
||||
| Model | Log-loss, any channel | PR-AUC, any channel | Log-loss, per channel | PR-AUC, per channel |
|
||||
|---|---|---|---|---|
|
||||
| rate by in-rotation-now | 0.2073 | 0.118 | 0.0666 | 0.052 |
|
||||
| rate by last-12-weeks level | 0.1831 | 0.201 | 0.0492 | 0.190 |
|
||||
| event model | 0.1803 | 0.258 | 0.0436 | 0.320 |
|
||||
| rate by in-rotation-now | 0.2073 | 0.115 | 0.0666 | 0.059 |
|
||||
| rate by last-12-weeks level | 0.1838 | 0.215 | 0.0491 | 0.202 |
|
||||
| event model (pre-release: NMF from history) | 0.1854 | 0.248 | 0.0445 | 0.314 |
|
||||
| event model (post-release: NMF known) | 0.1814 | 0.280 | 0.0422 | 0.325 |
|
||||
|
||||
Skill of the event model, any channel: 0.130 (0.085 to 0.187) vs in-rotation-now, 0.015 (-0.036 to 0.061) vs last-12-weeks level.
|
||||
Skill of the event model, any channel: 0.106 (0.081 to 0.178) vs in-rotation-now, -0.008 (-0.051 to 0.068) vs last-12-weeks level.
|
||||
|
||||
| Any-channel feature (all events) | Coefficient |
|
||||
|---|---|
|
||||
| intercept | -3.676 |
|
||||
| log DR plays t | +0.461 |
|
||||
| log DR plays 4w | +0.667 |
|
||||
| log DR plays 12w | -0.467 |
|
||||
| log max DR plays 12w | +0.260 |
|
||||
| in rotation anywhere now | -0.464 |
|
||||
| station groups in rotation now (/5) | -0.219 |
|
||||
| current run anywhere (/12) | -1.217 |
|
||||
| weeks since in rotation anywhere (/12) | -0.542 |
|
||||
| Track Top-40 score | -0.339 |
|
||||
| Airplay Top-20 score | -0.125 |
|
||||
| chart entry recency 6w | +0.509 |
|
||||
| chart entry recency 26w | +0.377 |
|
||||
| log Track Top-40 hits | -0.310 |
|
||||
| log Airplay Top-20 hits | -0.180 |
|
||||
| Danish | +0.640 |
|
||||
| group | +0.038 |
|
||||
| female | -0.081 |
|
||||
| career years (/50) | +0.505 |
|
||||
| debut unknown | +0.552 |
|
||||
| intercept | -3.665 |
|
||||
| log DR plays t | +0.557 |
|
||||
| log DR plays 4w | +0.507 |
|
||||
| log DR plays 12w | -0.363 |
|
||||
| log max DR plays 12w | +0.249 |
|
||||
| in rotation anywhere now | -0.476 |
|
||||
| station groups in rotation now (/5) | -0.252 |
|
||||
| current run anywhere (/12) | -1.197 |
|
||||
| weeks since in rotation anywhere (/12) | -0.514 |
|
||||
| Track Top-40 score | -0.282 |
|
||||
| Airplay Top-20 score | -0.313 |
|
||||
| chart entry recency 6w | +0.713 |
|
||||
| chart entry recency 26w | +0.477 |
|
||||
| log Track Top-40 hits | -0.303 |
|
||||
| log Airplay Top-20 hits | -0.118 |
|
||||
| Danish | +0.580 |
|
||||
| group | +0.043 |
|
||||
| female | -0.064 |
|
||||
| career years (/50) | +0.433 |
|
||||
| debut unknown | +0.530 |
|
||||
| Christmas in window | +0.000 |
|
||||
| discography known | -0.000 |
|
||||
| release recency 4w | +0.167 |
|
||||
| release recency 12w | -0.863 |
|
||||
| log releases last 52w | -0.208 |
|
||||
| releases in the window | -0.000 |
|
||||
| releases in window x not in rotation now | +0.464 |
|
||||
| DR: weeks since last add 13-25 | -0.027 |
|
||||
| DR: last add 26+ weeks ago | +0.411 |
|
||||
| DR: no add in the panel yet | -0.679 |
|
||||
| Airplay Top-20: last new song 13-25 weeks ago | +0.478 |
|
||||
| Airplay Top-20: 0.5-1.25x own usual gap | -0.177 |
|
||||
| Airplay Top-20: last new song 2+ years ago | -0.035 |
|
||||
| log archive plays per 100 sampled hours (2012-21) | +0.583 |
|
||||
| log DR lists with the artist before t (2023-) | +0.192 |
|
||||
| DR list recency 26w | -0.900 |
|
||||
| DR lists known before t at all | +0.491 |
|
||||
| NMF Denmark in the window | +0.886 |
|
||||
| NMF Denmark top 10 in the window | +0.810 |
|
||||
| log NMF Denmark placements last 52w | -0.024 |
|
||||
| share of releases on NMF Denmark (2 years) | -0.468 |
|
||||
| season index of the window (log, IFPI 2002-24) | +0.414 |
|
||||
| discography known | +0.000 |
|
||||
| release recency 4w | +0.243 |
|
||||
| release recency 12w | -0.814 |
|
||||
| log releases last 52w | -0.224 |
|
||||
| releases in the window | +0.000 |
|
||||
| releases in window x not in rotation now | +0.476 |
|
||||
| DR: weeks since last add 13-25 | -0.054 |
|
||||
| DR: last add 26+ weeks ago | +0.497 |
|
||||
| DR: no add in the panel yet | -0.684 |
|
||||
| Airplay Top-20: last new song 13-25 weeks ago | +0.463 |
|
||||
| Airplay Top-20: 0.5-1.25x own usual gap | -0.144 |
|
||||
| Airplay Top-20: last new song 2+ years ago | -0.107 |
|
||||
| log archive plays per 100 sampled hours (2012-21) | +0.532 |
|
||||
| log DR lists with the artist before t (2023-) | +0.108 |
|
||||
| DR list recency 26w | -0.955 |
|
||||
| DR lists known before t at all | +0.572 |
|
||||
| NMF Denmark in the window | +0.866 |
|
||||
| NMF Denmark top 10 in the window | +0.788 |
|
||||
| log NMF Denmark placements last 52w | -0.047 |
|
||||
| share of releases on NMF Denmark (2 years) | -0.354 |
|
||||
| season index of the window (log, IFPI 2002-24) | +0.372 |
|
||||
|
||||
Reference in New Issue
Block a user