Online Appendix
This web page is a companion to our ICSE 2012 submission entitled "Rapid Software Prototyping via Mining Open-Source Repositories."
- Our Approach
Our approach is available for public testing. Try it!
- Extracted Features
We extracted 1,135 features from the repositories for use in our tool. A list of these features is available here: extracted_features.zip
- User Study Materials
Our user study consisted of 12 tasks divided among 2 groups of participants in 2 experiments, as shown in the design below. During the experiments, the participants used the different approaches and filled out worksheets with their ratings. You can download those worksheets and other materials here: user_study_materials.zip
Experiment | Group | Approach | Task Set |
1 | A | Our Approach | T1 |
B | State-of-the-Art | T2 |
2 | A | State-of-the-Art | T3 |
B | Our Approach | T4 |
- Raw User Study Results
The participants read the results, entered queries into the assigned approach, and recorded and rated the recommendations. All of the worksheets (tabulated in Excel) are available here: user_study_raw_results.zip
- Metrics for Evaluation
We computed confidence, precision, and coverage for the different approaches. The metrics are defined in the paper, and the scripts we used to compute the metrics are available here: user_study_metrics.zip
- Final Results
All Excel files containing our metrics and statistical tests can be found here: user_study_analysis.zip