Files
Airplay-Predictor/docs/BACKTEST-EVENTS.md
T

2.6 KiB

Backtest: if the artist releases a new song, will DR add it?

Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 130 (5.6%) got an add on some DR channel.

Model Log-loss, any channel PR-AUC, any channel Log-loss, per channel PR-AUC, per channel
rate by in-rotation-now 0.2073 0.118 0.0666 0.052
rate by last-12-weeks level 0.1831 0.201 0.0492 0.190
event model 0.1803 0.258 0.0436 0.320

Skill of the event model, any channel: 0.130 (0.085 to 0.187) vs in-rotation-now, 0.015 (-0.036 to 0.061) vs last-12-weeks level.

Any-channel feature (all events) Coefficient
intercept -3.676
log DR plays t +0.461
log DR plays 4w +0.667
log DR plays 12w -0.467
log max DR plays 12w +0.260
in rotation anywhere now -0.464
station groups in rotation now (/5) -0.219
current run anywhere (/12) -1.217
weeks since in rotation anywhere (/12) -0.542
Track Top-40 score -0.339
Airplay Top-20 score -0.125
chart entry recency 6w +0.509
chart entry recency 26w +0.377
log Track Top-40 hits -0.310
log Airplay Top-20 hits -0.180
Danish +0.640
group +0.038
female -0.081
career years (/50) +0.505
debut unknown +0.552
Christmas in window +0.000
discography known -0.000
release recency 4w +0.167
release recency 12w -0.863
log releases last 52w -0.208
releases in the window -0.000
releases in window x not in rotation now +0.464
DR: weeks since last add 13-25 -0.027
DR: last add 26+ weeks ago +0.411
DR: no add in the panel yet -0.679
Airplay Top-20: last new song 13-25 weeks ago +0.478
Airplay Top-20: 0.5-1.25x own usual gap -0.177
Airplay Top-20: last new song 2+ years ago -0.035
log archive plays per 100 sampled hours (2012-21) +0.583
log DR lists with the artist before t (2023-) +0.192
DR list recency 26w -0.900
DR lists known before t at all +0.491
NMF Denmark in the window +0.886
NMF Denmark top 10 in the window +0.810
log NMF Denmark placements last 52w -0.024
share of releases on NMF Denmark (2 years) -0.468
season index of the window (log, IFPI 2002-24) +0.414