Files
Airplay-Predictor/docs/BACKTEST-EVENTS.md
T

2.6 KiB

Backtest: if the artist releases a new song, will DR add it?

Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 100 (4.3%) got an add on some DR channel.

Model Log-loss, any channel PR-AUC, any channel Log-loss, per channel PR-AUC, per channel
rate by in-rotation-now 0.1791 0.042 0.0572 0.011
rate by last-12-weeks level 0.1604 0.116 0.0434 0.123
event model 0.1584 0.179 0.0383 0.286

Skill of the event model, any channel: 0.116 (0.062 to 0.184) vs in-rotation-now, 0.013 (-0.020 to 0.060) vs last-12-weeks level.

Any-channel feature (all events) Coefficient
intercept -5.514
log DR plays t +0.487
log DR plays 4w +0.863
log DR plays 12w -0.819
log max DR plays 12w +0.447
in rotation anywhere now -1.356
station groups in rotation now (/5) -0.502
current run anywhere (/12) -1.525
weeks since in rotation anywhere (/12) +0.129
Track Top-40 score -0.489
Airplay Top-20 score -0.429
chart entry recency 6w +0.330
chart entry recency 26w -0.124
log Track Top-40 hits -0.307
log Airplay Top-20 hits -0.100
Danish +0.758
group -0.007
female +0.124
career years (/50) +0.528
debut unknown +0.596
Christmas in window +0.000
discography known -0.000
release recency 4w -0.124
release recency 12w -0.866
log releases last 52w -0.175
releases in the window -0.000
releases in window x not in rotation now +1.356
DR: weeks since last add 13-25 +0.144
DR: last add 26+ weeks ago +0.659
DR: no add in the panel yet -0.622
Airplay Top-20: last new song 13-25 weeks ago +0.399
Airplay Top-20: 0.5-1.25x own usual gap -0.497
Airplay Top-20: last new song 2+ years ago -0.069
log archive plays per 100 sampled hours (2012-21) +0.316
log DR lists with the artist before t (2023-) +0.431
DR list recency 26w +0.049
DR lists known before t at all -0.016
NMF Denmark in the window +0.774
NMF Denmark top 10 in the window +0.784
log NMF Denmark placements last 52w -0.067
share of releases on NMF Denmark (2 years) -0.590
season index of the window (log, IFPI 2002-24) +0.452