24 lines
1.2 KiB
Markdown
24 lines
1.2 KiB
Markdown
# Add definitions vs DR's own lists
|
||
|
||
Truth: artists with a song new on a list vs the previous list of the channel. Recall over all list pairs (24), and recall and precision over pairs at most 8 weeks apart (15). Precision is a lower bound: songs added and dropped between lists, or added off-list, count against it.
|
||
|
||
| Definition | Recall, all pairs | Recall, close pairs | Precision, close pairs | F1, close pairs | Adds detected | New songs |
|
||
|---|---|---|---|---|---|---|
|
||
| onset | 64% | 55% | 22% | 0.32 | 351 | 177 |
|
||
| surge [0.6, 0.5, 0.5, 0.25] | 77% | 68% | 25% | 0.36 | 420 | 177 |
|
||
|
||
Surge constants tried (floor × τ, jump × τ, jump × baseline, held next week), best F1 on close pairs:
|
||
|
||
| Constants | Recall | Precision | F1 |
|
||
|---|---|---|---|
|
||
| [0.4, 0.3, 1.0, 0.5] | 65% | 26% | 0.369 |
|
||
| [0.4, 0.3, 0.5, 0.5] | 68% | 25% | 0.368 |
|
||
| [0.6, 0.3, 1.0, 0.5] | 64% | 26% | 0.368 |
|
||
| [0.4, 0.3, 0.25, 0.5] | 69% | 25% | 0.367 |
|
||
| [0.6, 0.5, 0.25, 0.25] | 70% | 25% | 0.365 |
|
||
| [0.6, 0.3, 0.5, 0.5] | 67% | 25% | 0.365 |
|
||
| [0.6, 0.5, 0.25, 0.5] | 68% | 25% | 0.365 |
|
||
| [0.6, 0.3, 0.25, 0.5] | 69% | 25% | 0.364 |
|
||
|
||
The grid's best F1 (0.369) is within noise of the current constants (0.36), so the defaults stay. Surge beats onset-only on both recall and precision.
|