MSR 2020
Mon 29 - Tue 30 June 2020
co-located with ICSE 2020
Mon 29 Jun 2020 15:00 - 15:10 at MSR:Zoom - Bugs & Issues Chair(s): Francisco Servant

This paper reports on a large-scale comparative evaluation of IR-based tools for automatic bug localization. We have divided the bug localization tools in our evaluation into the following three generations: (1) The first-generation tools, now almost a decade old, are based purely on Bag-of-Words (BoW) modeling of software libraries; (2) The second-generation tools that augment BoW-based modeling with two additional pieces of information: historical data, such as change history, and structured information such as class names, method names, etc. And, (3) The most recent third-generation tools that additionally also exploit proximity, order, and semantic relationships between the terms. It is important to realize that the original authors of all these three generations of tools tested them on relatively small-sized datasets that typically consisted no more than a few thousand bug reports. And, for an even more serious shortcoming, those evaluations only involved Java code libraries. The goal of the present paper is to present a comprehensive large-scale evaluation of all three generations of bug-localization tools with code libraries in multiple languages. Our study involves over 20,000 bug reports drawn from a diverse collection of Java, C/C++, and Python projects.

Mon 29 Jun

Displayed time zone: (UTC) Coordinated Universal Time change

14:30 - 15:30
Bugs & IssuesTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Francisco Servant Virginia Tech

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

14:30
10m
Live Q&A
Dataset of Video Game Development ProblemsMSR - Data Showcase
Data Showcase
A: Cristiano Politowski Concordia University, Canada, A: Fabio Petrillo University of Quebec at Chicoutimi, A: Yann-Gaël Guéhéneuc Concordia University and Polytechnique Montréal, A: Gabriel Cavalheiro Ullmann UNIJUI - Universidade Regional do Noroeste do Estado do Rio Grande do Sul, A: Josias De Andrade Werly
Media Attached
14:40
10m
Live Q&A
On the Relationship between User Churn and Software IssuesMSR - Technical Paper
Technical Papers
Omar El Zarif , Daniel Alencar Da Costa University of Otago, Safwat Hassan Queens University, Kingston, Canada, Ying Zou Queen's University, Kingston, Ontario
Pre-print Media Attached
14:50
10m
Live Q&A
A Soft Alignment Model for Bug DeduplicationMSR - Technical Paper
Technical Papers
Pre-print Media Attached
15:00
10m
Live Q&A
A Large-Scale Comparative Evaluation of IR-Based Tools for Bug LocalizationMSR - Technical Paper
Technical Papers
Media Attached
15:10
10m
Live Q&A
How Often Do Single-Statement Bugs Occur? The ManySStuBs4J DatasetMSR - Data Showcase
Data Showcase
A: Rafael-Michael Karampatsis The University of Edinburgh, A: Charles Sutton Google Research
Pre-print Media Attached
15:20
10m
Live Q&A
Large-Scale Manual Validation of Bugfixing ChangesMSR - Registered Reports
Registered Reports
A: Steffen Herbold University of Göttingen, A: Alexander Trautsch University of Göttingen, A: Benjamin Ledel
Pre-print Media Attached