MSR 2020
Mon 29 - Tue 30 June 2020
co-located with ICSE 2020
Mon 29 Jun 2020 15:00 - 15:10 at MSR:Zoom - Bugs & Issues Chair(s): Francisco Servant

This paper reports on a large-scale comparative evaluation of IR-based tools for automatic bug localization. We have divided the bug localization tools in our evaluation into the following three generations: (1) The first-generation tools, now almost a decade old, are based purely on Bag-of-Words (BoW) modeling of software libraries; (2) The second-generation tools that augment BoW-based modeling with two additional pieces of information: historical data, such as change history, and structured information such as class names, method names, etc. And, (3) The most recent third-generation tools that additionally also exploit proximity, order, and semantic relationships between the terms. It is important to realize that the original authors of all these three generations of tools tested them on relatively small-sized datasets that typically consisted no more than a few thousand bug reports. And, for an even more serious shortcoming, those evaluations only involved Java code libraries. The goal of the present paper is to present a comprehensive large-scale evaluation of all three generations of bug-localization tools with code libraries in multiple languages. Our study involves over 20,000 bug reports drawn from a diverse collection of Java, C/C++, and Python projects.

Mon 29 Jun
Times are displayed in time zone: (UTC) Coordinated Universal Time change

msr-2020-papers
14:30 - 15:30: Technical Papers - Bugs & Issues at MSR:Zoom
Chair(s): Francisco ServantVirginia Tech

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

msr-2020-Data-showcase14:30 - 14:40
Live Q&A
Cristiano PolitowskiConcordia University, Canada, Fabio PetrilloUniversity of Quebec at Chicoutimi, Yann-Gaël GuéhéneucConcordia University and Polytechnique Montréal, Gabriel Cavalheiro UllmannUNIJUI - Universidade Regional do Noroeste do Estado do Rio Grande do Sul, Josias De Andrade Werly
Media Attached
msr-2020-papers14:40 - 14:50
Live Q&A
Omar El Zarif, Daniel Alencar Da CostaUniversity of Otago, Safwat HassanQueens University, Kingston, Canada, Ying ZouQueen's University, Kingston, Ontario
Pre-print Media Attached
msr-2020-papers14:50 - 15:00
Live Q&A
Pre-print Media Attached
msr-2020-papers15:00 - 15:10
Live Q&A
Media Attached
msr-2020-Data-showcase15:10 - 15:20
Live Q&A
Rafael-Michael KarampatsisThe University of Edinburgh, Charles SuttonGoogle Research
Pre-print Media Attached
msr-2020-Registered-Reports15:20 - 15:30
Live Q&A
Steffen HerboldUniversity of Göttingen, Alexander TrautschUniversity of Göttingen, Benjamin Ledel
Pre-print Media Attached