Files
Airplay-Predictor/docs/ADDCHECK.md
T

24 lines
1.2 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Add definitions vs DR's own lists
Truth: artists with a song new on a list vs the previous list of the channel. Recall over all list pairs (24), and recall and precision over pairs at most 8 weeks apart (15). Precision is a lower bound: songs added and dropped between lists, or added off-list, count against it.
| Definition | Recall, all pairs | Recall, close pairs | Precision, close pairs | F1, close pairs | Adds detected | New songs |
|---|---|---|---|---|---|---|
| onset | 64% | 55% | 22% | 0.32 | 351 | 177 |
| surge [0.6, 0.5, 0.5, 0.25] | 77% | 68% | 25% | 0.36 | 420 | 177 |
Surge constants tried (floor × τ, jump × τ, jump × baseline, held next week), best F1 on close pairs:
| Constants | Recall | Precision | F1 |
|---|---|---|---|
| [0.4, 0.3, 1.0, 0.5] | 65% | 26% | 0.369 |
| [0.4, 0.3, 0.5, 0.5] | 68% | 25% | 0.368 |
| [0.6, 0.3, 1.0, 0.5] | 64% | 26% | 0.368 |
| [0.4, 0.3, 0.25, 0.5] | 69% | 25% | 0.367 |
| [0.6, 0.5, 0.25, 0.25] | 70% | 25% | 0.365 |
| [0.6, 0.3, 0.5, 0.5] | 67% | 25% | 0.365 |
| [0.6, 0.5, 0.25, 0.5] | 68% | 25% | 0.365 |
| [0.6, 0.3, 0.25, 0.5] | 69% | 25% | 0.364 |
The grid's best F1 (0.369) is within noise of the current constants (0.36), so the defaults stay. Surge beats onset-only on both recall and precision.