Triaging Incoming Change Requests: Bug or Commit History, or Code Authorship? - ICSM 2012 Online Appendix
This web page is a companion to our ICSM 2012 submission entitled "Triaging Incoming Change Requests: Bug or Commit History, or Code Authorship?".
Results
Precision and Recall on benchmark data (ArgoUML)
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 549 | 1 | 0.5 | 1 | 1 | 0.666666667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.333333333 | 1 | 0.285714286 | 1 | 0.25 | 1 | 0.222222222 | 1 | 0.2 | 1 |
| 1641 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 1671 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1884 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1911 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 1942 | 1 | 0.5 | 0.5 | 0.5 | 0.333333333 | 0.5 | 0.25 | 0.5 | 0.4 | 1 | 0.333333333 | 1 | 0.285714286 | 1 | 0.25 | 1 | 0.222222222 | 1 | 0.2 | 1 |
| 2144 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2145 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2225 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2460 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 2472 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2500 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2522 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2618 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2712 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 2732 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3145 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3164 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3197 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3350 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3363 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3498 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3619 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3631 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3665 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3711 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3718 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3773 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3774 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3790 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3803 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3812 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3814 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3848 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3882 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3911 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3912 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3918 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3921 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3923 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3938 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3945 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3947 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 3974 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4005 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4007 | 0 | 0 | 0.5 | 0.5 | 0.666666667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.333333333 | 1 | 0.285714286 | 1 | 0.25 | 1 | 0.222222222 | 1 | 0.2 | 1 |
| 4019 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4031 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4037 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4043 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4049 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4078 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4085 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4088 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4100 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4101 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4103 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4129 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4130 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4137 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4148 | 0 | 0 | 0.5 | 0.5 | 0.333333333 | 0.5 | 0.5 | 1 | 0.4 | 1 | 0.333333333 | 1 | 0.285714286 | 1 | 0.25 | 1 | 0.222222222 | 1 | 0.2 | 1 |
| 4155 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4162 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4173 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4178 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4180 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4181 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4194 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4200 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4222 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4227 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4231 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4245 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4272 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4276 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4279 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4280 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4281 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4298 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4302 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4324 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4330 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4342 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4349 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4354 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4362 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4363 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4364 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4367 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 4372 | 1 | 0.5 | 1 | 1 | 0.666666667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.333333333 | 1 | 0.285714286 | 1 | 0.25 | 1 | 0.222222222 | 1 | 0.2 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 549 | 1 | 0.5 | 1 | 1 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 1641 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 1671 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 1884 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1911 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1942 | 0 | 0 | 0 | 0 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.125 | 0.5 | 0.2222 | 1 | 0.2 | 1 |
| 2144 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 2145 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 2225 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2460 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2472 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2500 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2522 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2618 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 2712 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2732 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 3100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 3145 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3164 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3197 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3350 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3363 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3498 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3619 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3631 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3665 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3711 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3718 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3773 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3774 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3790 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3803 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3812 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 3814 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3848 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3882 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3911 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3912 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3918 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3921 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3923 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 3938 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3945 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3947 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3974 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4005 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4007 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4019 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4031 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4037 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4043 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4049 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4078 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4085 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4088 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 4100 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4101 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4103 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4129 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4130 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4137 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4148 | 0 | 0 | 0.5 | 0.5 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 4155 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4162 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4173 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4178 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4180 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4181 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4194 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4200 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4222 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4272 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4276 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4279 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4280 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4281 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4298 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4302 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4324 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1 | 1 |
| 4330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4342 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4349 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4354 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4362 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4364 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4367 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4372 | 0 | 0 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 549 | 1 | 0.5 | 1 | 1 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 1641 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1671 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1884 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1911 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1942 | 0 | 0 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 2144 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2145 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2225 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2460 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2472 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2500 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2522 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2618 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2712 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2732 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1 | 1 |
| 3100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3145 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3164 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3197 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3350 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3363 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3498 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3619 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3631 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3665 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3711 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3718 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3773 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3774 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3790 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3803 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3812 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3814 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3848 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3882 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3911 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3912 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3918 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3921 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3923 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1 | 1 |
| 3938 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3945 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3947 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3974 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4005 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4007 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4019 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4031 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4037 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4043 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4049 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4078 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4085 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1 | 1 |
| 4088 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4100 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4101 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4103 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4129 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4130 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4137 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4148 | 0 | 0 | 0.5 | 0.5 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 4155 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4162 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4173 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4178 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4180 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4181 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4194 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4200 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4222 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4272 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4276 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4279 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4280 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4281 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4298 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4302 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4324 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4342 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4349 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4354 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4362 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4364 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4367 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4372 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 549 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 1641 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1671 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 1884 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1911 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1942 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.125 | 0.5 | 0.1111 | 0.5 | 0.1 | 0.5 |
| 2144 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2145 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2225 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2460 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2472 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 2500 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 2522 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 2618 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2712 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2732 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3145 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3164 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3197 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 3350 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 3498 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3619 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3631 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3665 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3711 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3718 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3773 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3774 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3790 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3803 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3812 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3814 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3848 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3882 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3911 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3912 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3918 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3921 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3923 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3938 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3945 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3947 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 3974 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4005 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4007 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1111 | 1 |
| 4019 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4031 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4037 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4043 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4049 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4078 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4085 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4088 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4100 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4101 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 4103 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4129 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 4130 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4148 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2222 | 1 |
| 4155 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4162 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4173 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4178 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4180 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4181 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4194 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4200 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4222 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 4245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4272 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 4276 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 4279 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4280 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4281 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4298 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 4302 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4324 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4342 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4349 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4354 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4362 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4364 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4367 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4372 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 549 | 1 | 0.5 | 0.5 | 0.5 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
| 1641 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1671 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1884 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1911 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 1942 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 | 0.3333 | 0.5 |
| 2144 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2145 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2225 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 2460 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2472 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 2500 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 2522 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 2618 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 2712 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 2732 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3100 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3145 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3164 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3197 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3350 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3498 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3619 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3631 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3665 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3711 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 3718 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3773 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3774 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 3790 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3803 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 3812 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 3814 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3848 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 3882 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3911 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 3912 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 3918 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3921 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3923 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3938 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 3945 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 3947 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 3974 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4005 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4007 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1111 | 1 | 0.1 | 1 |
| 4019 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4031 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4037 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4043 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4049 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4078 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4085 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4088 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4100 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4101 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4103 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4129 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4130 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4148 | 1 | 0.5 | 1 | 1 | 0.6667 | 1 | 0.5 | 1 | 0.4 | 1 | 0.3333 | 1 | 0.2857 | 1 | 0.25 | 1 | 0.2222 | 1 | 0.2222 | 1 |
| 4155 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4162 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4173 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4178 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4180 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4181 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4194 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4200 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 4222 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 4245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4272 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 4276 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 4279 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4280 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4281 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4298 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 4302 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 4324 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4342 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4349 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 4354 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4362 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4363 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 4364 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4367 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4372 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 0.5 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.25 | 1 | 0.2222 | 1 | 0.2 | 1 |
Authors
- Mario Linares-Vásquez - The College of William and Mary. E-mail: mlinarev at wm dot edu
- Kamal Hosen - Whichita State University. Email: mxhossen at cs dot wichita dot edu
- Hoang Dang - Whichita State University. Email: hndang at cs dot wichita dot edu
- Huzefa Kagdi - Whichita State University. Email: kagdi at cs dot wichita dot edu
- Malcom Gethers - The College of William and Mary. E-mail: mgethers at cs dot wm dot edu
- Denys Poshyvanyk - The College of William and Mary. E-mail: denys at cs dot wm dot edu