Files
Airplay-Predictor/docs/BACKTEST-EVENTS.md
T

2.6 KiB

Backtest: if the artist releases a new song, will DR add it?

Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 100 (4.3%) got an add on some DR channel.

Model Log-loss, any channel PR-AUC, any channel Log-loss, per channel PR-AUC, per channel
rate by in-rotation-now 0.1791 0.042 0.0572 0.011
rate by last-12-weeks level 0.1604 0.116 0.0434 0.123
event model 0.1555 0.186 0.0373 0.273

Skill of the event model, any channel: 0.132 (0.090 to 0.200) vs in-rotation-now, 0.031 (0.010 to 0.079) vs last-12-weeks level.

Any-channel feature (all events) Coefficient
intercept -5.512
log DR plays t +0.487
log DR plays 4w +0.863
log DR plays 12w -0.818
log max DR plays 12w +0.446
in rotation anywhere now -1.356
station groups in rotation now (/5) -0.502
current run anywhere (/12) -1.526
weeks since in rotation anywhere (/12) +0.130
Track Top-40 score -0.490
Airplay Top-20 score -0.429
chart entry recency 6w +0.331
chart entry recency 26w -0.122
log Track Top-40 hits -0.308
log Airplay Top-20 hits -0.100
Danish +0.759
group -0.008
female +0.124
career years (/50) +0.528
debut unknown +0.596
Christmas in window +0.000
discography known -0.000
release recency 4w -0.124
release recency 12w -0.866
log releases last 52w -0.177
releases in the window -0.000
releases in window x not in rotation now +1.356
DR: weeks since last add 13-25 +0.144
DR: last add 26+ weeks ago +0.659
DR: no add in the panel yet -0.622
Airplay Top-20: last new song 13-25 weeks ago +0.398
Airplay Top-20: 0.5-1.25x own usual gap -0.496
Airplay Top-20: last new song 2+ years ago -0.070
log archive plays per 100 sampled hours (2012-21) +0.317
log DR lists with the artist before t (2023-) +0.431
DR list recency 26w +0.046
DR lists known before t at all -0.014
NMF Denmark in the window +0.769
NMF Denmark top 10 in the window +0.783
log NMF Denmark placements last 52w -0.056
share of releases on NMF Denmark (2 years) -0.600
season index of the window (log, IFPI 2002-24) +0.451