Triaging Incoming Change Requests: Bug or Commit History, or Code Authorship? - ICSM 2012 Online Appendix
This web page is a companion to our ICSM 2012 submission entitled "Triaging Incoming Change Requests: Bug or Commit History, or Code Authorship?".
Results
Precision and Recall on benchmark data (MuCommander)
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 1 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 7 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 10 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 11 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 13 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 16 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 20 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 21 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 24 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 30 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 31 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 37 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 39 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 43 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 45 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 48 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 52 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 59 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 60 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 66 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 67 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 77 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 78 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 85 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 86 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 87 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 89 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 91 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 94 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 98 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 102 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 103 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 107 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 108 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 110 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 111 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 116 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 117 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 137 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 138 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 140 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 142 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 145 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 147 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 151 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 153 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 163 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 164 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 165 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 166 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 167 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 173 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 176 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 177 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 178 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 179 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 212 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 213 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 214 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 217 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 221 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 225 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 227 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 231 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 233 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 235 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 237 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 238 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 243 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 244 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 245 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 247 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 248 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 250 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 251 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 254 | 0 | 0 | 0 | 0 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 258 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 261 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 274 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 277 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 309 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 311 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 313 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 317 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 321 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 327 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 328 | 0 | 0 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| 330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 331 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 334 | 1 | 1 | 0.5 | 1 | 0.333333333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.166666667 | 1 | 0.142857143 | 1 | 0.125 | 1 | 0.111111111 | 1 | 0.1 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 1 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 7 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 10 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 11 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 13 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 16 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 20 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 21 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 24 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 30 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 31 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 37 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 39 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 43 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 45 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 48 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 52 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 59 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 60 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 66 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 67 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 77 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 78 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 85 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 86 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 87 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 89 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 91 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 94 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 98 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 102 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 103 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 107 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 108 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 110 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 111 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 116 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 117 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 138 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 140 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 142 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 145 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 147 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 151 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 153 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 163 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.125 | 0.5 | 0.125 | 0.5 | 0.125 | 0.5 |
| 164 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 165 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 166 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 167 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 173 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 176 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 177 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 178 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 179 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 212 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 213 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 214 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 217 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 221 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 225 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 233 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 235 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 237 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 238 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 243 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 244 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 247 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 248 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 250 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 251 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 254 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 258 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 261 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 274 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 277 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 309 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 311 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 313 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 317 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 321 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 327 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 328 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 331 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 334 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 1 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 7 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 10 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 11 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 13 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 16 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 20 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 21 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 24 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 30 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 31 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 37 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 39 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 43 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 45 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 48 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 52 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 59 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 60 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 66 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 67 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 77 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 78 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 85 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 86 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 87 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 89 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 91 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 94 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 98 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 102 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 103 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 107 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 108 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 110 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 111 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 116 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 117 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 138 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 140 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 142 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 145 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 147 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 151 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 153 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 163 | 1 | 0.5 | 0.5 | 0.5 | 0.3333 | 0.5 | 0.25 | 0.5 | 0.2 | 0.5 | 0.1667 | 0.5 | 0.1429 | 0.5 | 0.125 | 0.5 | 0.125 | 0.5 | 0.125 | 0.5 |
| 164 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 165 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 166 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 167 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 173 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 176 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 177 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 178 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 179 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 212 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 213 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 214 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 217 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 221 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 225 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1 | 1 |
| 227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 233 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 235 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 237 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 238 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 243 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 244 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 247 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 248 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 250 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 251 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 254 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 258 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 261 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 274 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 277 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 309 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.125 | 1 | 0.125 | 1 |
| 311 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 313 | 0 | 0 | 0 | 0 | 0 | 0 | 0.25 | 1 | 0.2 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 317 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 321 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 327 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 328 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 | 0.1429 | 1 |
| 330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 331 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1429 | 1 | 0.125 | 1 | 0.1111 | 1 | 0.1111 | 1 |
| 334 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 1 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 7 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 10 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 11 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 13 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 16 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 20 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 21 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 24 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 30 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 31 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 37 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 39 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 43 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 45 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 48 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 52 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 59 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 60 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 66 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 67 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 77 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 78 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 85 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 86 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 87 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 89 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 91 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 94 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 98 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 102 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 103 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 107 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 108 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 110 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 111 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 116 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 117 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 138 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 140 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 142 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 145 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 147 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 151 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 153 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 163 | 1 | 0.5 | 1 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 | 0.6667 | 1 |
| 164 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 165 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 166 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 167 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 173 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 176 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 177 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 178 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 179 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 212 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 213 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 214 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 217 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 221 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 225 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 227 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 233 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 235 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 237 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 238 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 243 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 244 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 247 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 248 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 250 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 251 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 254 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 258 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 261 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 274 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 277 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 309 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 311 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 313 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 317 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 321 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 327 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 328 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 | 0.1667 | 1 |
| 331 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 334 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| Top-1 | Top-2 | Top-3 | Top-4 | Top-5 | Top-6 | Top-7 | Top-8 | Top-9 | Top-10 | |||||||||||
| Issue Number | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall | Precision | Recall |
| 1 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 7 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 10 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 11 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 13 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 16 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 20 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 21 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 24 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 30 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 31 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 37 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 39 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 43 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 45 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 48 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 52 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 59 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 60 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 66 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 67 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 77 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 78 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 85 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 86 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 87 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 89 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 91 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 94 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 98 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 102 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 103 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 107 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 108 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 110 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 111 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 116 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 117 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 137 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 138 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 140 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 142 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 145 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 147 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 151 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 153 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 163 | 1 | 0.5 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 164 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 165 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 166 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 167 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 173 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 176 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 177 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 178 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 179 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 212 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 213 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 214 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 217 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 221 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 225 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 227 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 231 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 233 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 235 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 237 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 238 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 243 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 244 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 245 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 247 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 248 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 250 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 251 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 254 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 258 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 261 | 0 | 0 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 274 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 277 | 1 | 1 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 | 0.25 | 1 |
| 309 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 311 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
| 313 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 317 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 321 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 327 | 0 | 0 | 0 | 0 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 | 0.3333 | 1 |
| 328 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 330 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 331 | 0 | 0 | 0.5 | 1 | 0.3333 | 1 | 0.25 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 | 0.2 | 1 |
| 334 | 1 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 | 0.5 | 1 |
Authors
- Mario Linares-Vásquez - The College of William and Mary. E-mail: mlinarev at wm dot edu
- Kamal Hosen - Whichita State University. Email: mxhossen at cs dot wichita dot edu
- Hoang Dang - Whichita State University. Email: hndang at cs dot wichita dot edu
- Huzefa Kagdi - Whichita State University. Email: kagdi at cs dot wichita dot edu
- Malcom Gethers - The College of William and Mary. E-mail: mgethers at cs dot wm dot edu
- Denys Poshyvanyk - The College of William and Mary. E-mail: denys at cs dot wm dot edu