2.6 KiB
2.6 KiB
Backtest: if the artist releases a new song, will DR add it?
Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 100 (4.3%) got an add on some DR channel.
| Model | Log-loss, any channel | PR-AUC, any channel | Log-loss, per channel | PR-AUC, per channel |
|---|---|---|---|---|
| rate by in-rotation-now | 0.1791 | 0.042 | 0.0572 | 0.011 |
| rate by last-12-weeks level | 0.1604 | 0.116 | 0.0434 | 0.123 |
| event model | 0.1555 | 0.186 | 0.0373 | 0.273 |
Skill of the event model, any channel: 0.132 (0.090 to 0.200) vs in-rotation-now, 0.031 (0.010 to 0.079) vs last-12-weeks level.
| Any-channel feature (all events) | Coefficient |
|---|---|
| intercept | -5.512 |
| log DR plays t | +0.487 |
| log DR plays 4w | +0.863 |
| log DR plays 12w | -0.818 |
| log max DR plays 12w | +0.446 |
| in rotation anywhere now | -1.356 |
| station groups in rotation now (/5) | -0.502 |
| current run anywhere (/12) | -1.526 |
| weeks since in rotation anywhere (/12) | +0.130 |
| Track Top-40 score | -0.490 |
| Airplay Top-20 score | -0.429 |
| chart entry recency 6w | +0.331 |
| chart entry recency 26w | -0.122 |
| log Track Top-40 hits | -0.308 |
| log Airplay Top-20 hits | -0.100 |
| Danish | +0.759 |
| group | -0.008 |
| female | +0.124 |
| career years (/50) | +0.528 |
| debut unknown | +0.596 |
| Christmas in window | +0.000 |
| discography known | -0.000 |
| release recency 4w | -0.124 |
| release recency 12w | -0.866 |
| log releases last 52w | -0.177 |
| releases in the window | -0.000 |
| releases in window x not in rotation now | +1.356 |
| DR: weeks since last add 13-25 | +0.144 |
| DR: last add 26+ weeks ago | +0.659 |
| DR: no add in the panel yet | -0.622 |
| Airplay Top-20: last new song 13-25 weeks ago | +0.398 |
| Airplay Top-20: 0.5-1.25x own usual gap | -0.496 |
| Airplay Top-20: last new song 2+ years ago | -0.070 |
| log archive plays per 100 sampled hours (2012-21) | +0.317 |
| log DR lists with the artist before t (2023-) | +0.431 |
| DR list recency 26w | +0.046 |
| DR lists known before t at all | -0.014 |
| NMF Denmark in the window | +0.769 |
| NMF Denmark top 10 in the window | +0.783 |
| log NMF Denmark placements last 52w | -0.056 |
| share of releases on NMF Denmark (2 years) | -0.600 |
| season index of the window (log, IFPI 2002-24) | +0.451 |