Files
Airplay-Predictor/docs/BACKTEST-EVENTS.md
T

2.8 KiB

Backtest: if the artist releases a new song, will DR add it?

Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out, or plays jumping well above the artist's own 8-week baseline and staying up) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 130 (5.6%) got an add on some DR channel.

Model Log-loss, any channel PR-AUC, any channel Log-loss, per channel PR-AUC, per channel
rate by in-rotation-now 0.2073 0.115 0.0666 0.059
rate by last-12-weeks level 0.1838 0.215 0.0491 0.202
event model (pre-release: NMF from history) 0.1854 0.248 0.0445 0.314
event model (post-release: NMF known) 0.1814 0.280 0.0422 0.325

Skill of the event model, any channel: 0.106 (0.081 to 0.178) vs in-rotation-now, -0.008 (-0.051 to 0.068) vs last-12-weeks level.

Any-channel feature (all events) Coefficient
intercept -3.665
log DR plays t +0.557
log DR plays 4w +0.507
log DR plays 12w -0.363
log max DR plays 12w +0.249
in rotation anywhere now -0.476
station groups in rotation now (/5) -0.252
current run anywhere (/12) -1.197
weeks since in rotation anywhere (/12) -0.514
Track Top-40 score -0.282
Airplay Top-20 score -0.313
chart entry recency 6w +0.713
chart entry recency 26w +0.477
log Track Top-40 hits -0.303
log Airplay Top-20 hits -0.118
Danish +0.580
group +0.043
female -0.064
career years (/50) +0.433
debut unknown +0.530
Christmas in window +0.000
discography known +0.000
release recency 4w +0.243
release recency 12w -0.814
log releases last 52w -0.224
releases in the window +0.000
releases in window x not in rotation now +0.476
DR: weeks since last add 13-25 -0.054
DR: last add 26+ weeks ago +0.497
DR: no add in the panel yet -0.684
Airplay Top-20: last new song 13-25 weeks ago +0.463
Airplay Top-20: 0.5-1.25x own usual gap -0.144
Airplay Top-20: last new song 2+ years ago -0.107
log archive plays per 100 sampled hours (2012-21) +0.532
log DR lists with the artist before t (2023-) +0.108
DR list recency 26w -0.955
DR lists known before t at all +0.572
NMF Denmark in the window +0.866
NMF Denmark top 10 in the window +0.788
log NMF Denmark placements last 52w -0.047
share of releases on NMF Denmark (2 years) -0.354
season index of the window (log, IFPI 2002-24) +0.372