Files
Airplay-Predictor/docs/BACKTEST-EVENTS.md
T

2.5 KiB

Backtest: if the artist releases a new song, will DR add it?

Events: an artist in the panel releases something (Deezer) in week t0+1, with no other release in the 6 weeks before (so an add can't be the previous song's); target: a DR add (entering rotation after 4+ weeks out) within the 8 weeks from the release week. The model knows the artist's state the week before; the new song's NMF Denmark placement is blended from the artist's history. 2302 release events scored, 100 (4.3%) got an add on some DR channel.

Model Log-loss, any channel PR-AUC, any channel Log-loss, per channel PR-AUC, per channel
rate by in-rotation-now 0.1791 0.042 0.0572 0.011
rate by last-12-weeks level 0.1604 0.116 0.0434 0.123
event model 0.1587 0.180 0.0384 0.286

Skill of the event model, any channel: 0.114 (0.058 to 0.183) vs in-rotation-now, 0.011 (-0.024 to 0.059) vs last-12-weeks level.

Any-channel feature (all events) Coefficient
intercept -5.518
log DR plays t +0.493
log DR plays 4w +0.865
log DR plays 12w -0.826
log max DR plays 12w +0.444
in rotation anywhere now -1.361
station groups in rotation now (/5) -0.501
current run anywhere (/12) -1.509
weeks since in rotation anywhere (/12) +0.122
Track Top-40 score -0.479
Airplay Top-20 score -0.431
chart entry recency 6w +0.327
chart entry recency 26w -0.115
log Track Top-40 hits -0.306
log Airplay Top-20 hits -0.103
Danish +0.754
group -0.006
female +0.124
career years (/50) +0.532
debut unknown +0.601
Christmas in window +0.000
discography known -0.000
release recency 4w -0.131
release recency 12w -0.869
log releases last 52w -0.172
releases in the window -0.000
releases in window x not in rotation now +1.361
DR: weeks since last add 13-25 +0.133
DR: last add 26+ weeks ago +0.694
DR: no add in the panel yet -0.625
Airplay Top-20: last new song 13-25 weeks ago +0.397
Airplay Top-20: 0.5-1.25x own usual gap -0.500
Airplay Top-20: last new song 2+ years ago -0.069
log archive plays per 100 sampled hours (2012-21) +0.316
log DR lists with the artist before t (2023-) +0.435
DR list recency 26w +0.032
DR lists known before t at all -0.016
NMF Denmark in the window +0.789
NMF Denmark top 10 in the window +0.775
log NMF Denmark placements last 52w -0.068
share of releases on NMF Denmark (2 years) -0.585