MSR 2020
Mon 29 - Tue 30 June 2020
co-located with ICSE 2020

To increase transparency and replicability of empirical research, other disciplines have started to offer preregistration and registered reports for studies. With preregistration, authors can submit an experimental plan, including hypotheses and expected outcome, and get feedback before data is collected. More information on preregistration can be found with the Open Science Initiative (https://cos.io/rr/). Due to its success, we are piloting a registered reports track at this year’s MSR.

Dates
Tracks
Plenary
You're viewing the program in a time zone which is different from your device's time zone - change time zone

Mon 29 Jun

Displayed time zone: (UTC) Coordinated Universal Time change

10:30 - 11:00
Programming Languages & ModelsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Dimitris Kolovos University of York

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

10:30
6m
Live Q&A
An Empirical Study on the Impact of Deimplicitization on Program ComprehensionMSR - Registered Reports
Registered Reports
A: Jürgen Cito MIT, A: Jiasi Shen Massachusetts Institute of Technology, A: Martin C. Rinard MIT
Pre-print Media Attached
10:36
6m
Live Q&A
AIMMX: Artificial Intelligence Model Metadata ExtractorMSR - Technical Paper
Technical Papers
Jason Tsay IBM Research, Alan Braz IBM Research, Martin Hirzel IBM Research, Avraham Shinnar IBM Research, Todd Mummert
Pre-print Media Attached
10:42
6m
Live Q&A
Using Large-Scale Anomaly Detection on Code to Improve Kotlin CompilerMSR - Technical Paper
Technical Papers
Timofey Bryksin JetBrains Research, Saint Petersburg State University, Victor Petukhov JetBrains, ITMO University, Ilya Alexin , Stanislav Prikhodko , Alexey Shpilman , Vladimir Kovalenko TU Delft, Nikita Povarov JetBrains
Pre-print Media Attached
10:48
6m
Live Q&A
An Empirical Study of Method Chaining in JavaMSR - Technical Paper
Technical Papers
Tomoki Nakamaru Graduate School of Information Science and Technology, The University of Tokyo, Tomomasa Matsunaga , Tetsuro Yamazaki Graduate School of Information Science and Technology, The University of Tokyo, Soramichi Akiyama Department of Creative Informatics, The University of Tokyo, Shigeru Chiba The University of Tokyo
Pre-print Media Attached
10:54
6m
Live Q&A
Painting Flowers: Reasons for Using Single-State State Machines in Model-Driven EngineeringMSR - Technical Paper
Technical Papers
Nan Yang Eindhoven University of Technology, The Netherlands, Pieter Cuijpers , Ramon Schiffelers Eindhoven University of Technology and ASML, the Netherlands, Johan Lukkien , Alexander Serebrenik Eindhoven University of Technology
Media Attached
10:30 - 11:00
Refactoring & TestingTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom2
Chair(s): Maurício Aniche Delft University of Technology, Netherlands

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

10:30
7m
Live Q&A
Characterizing and Identifying Composite Refactorings: Concepts, Heuristics and PatternsMSR - Technical Paper
Technical Papers
Leonardo Da Silva Sousa Carnegie Mellon University, USA, Diego Cedrim Pontifical Catholic University of Rio de Janeiro, Alessandro Garcia PUC-Rio, Willian Oizumi PUC-Rio, Ana Carla Bibiano PUC-Rio, Daniel Oliveira PUC-Rio, Miryung Kim University of California, Los Angeles, Anderson Oliveira PUC-Rio
Pre-print Media Attached
10:37
7m
Live Q&A
Behind the Intents: An In-depth Empirical Study on Software Refactoring in Modern Code ReviewMSR - Technical Paper
Technical Papers
Matheus Paixao University of Fortaleza, Anderson Uchôa Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Ana Carla Bibiano PUC-Rio, Daniel Oliveira PUC-Rio, Alessandro Garcia PUC-Rio, Jens Krinke University College London, Emilio Arvonio
Pre-print Media Attached
10:45
7m
Live Q&A
JTeC: A Large Collection of Java Test Classes for Test Code Analysis and ProcessingMSR - Data Showcase
Data Showcase
Federico Corò , A: Roberto Verdecchia Vrije Universiteit Amsterdam, A: Emilio Cruciani , A: Breno Miranda Federal University of Pernambuco, A: Antonia Bertolino CNR-ISTI
Pre-print Media Attached
10:52
7m
Live Q&A
TestRoutes: A Manually Curated Method Level Dataset for Test-to-Code TraceabilityMSR - Data Showcase
Data Showcase
A: András Kicsi , A: László Vidács University of Szeged, Hungary, A: Tibor Gyimothy
Pre-print Media Attached
11:00 - 12:00
Build, CI, & DependenciesTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Raula Gaikovina Kula NAIST

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

11:00
12m
Live Q&A
A Tale of Docker Build Failures: A Preliminary StudyMSR - Technical Paper
Technical Papers
Yiwen Wu National University of Defense Technology, Yang Zhang National University of Defense Technology, China, Tao Wang National University of Defense Technology, Huaimin Wang
Pre-print Media Attached
11:12
12m
Live Q&A
Using Others' Tests to Avoid Breaking UpdatesMSR - Technical Paper
Technical Papers
Suhaib Mujahid Concordia University, Rabe Abdalkareem Concordia University, Montreal, Canada, Emad Shihab Concordia University, Shane McIntosh McGill University
Pre-print Media Attached
11:24
12m
Live Q&A
A Dataset of DockerfilesMSR - Data Showcase
Data Showcase
A: Jordan Henkel University of Wisconsin–Madison, A: Christian Bird , A: Shuvendu Lahiri Microsoft Research, A: Thomas Reps University of Wisconsin-Madison, USA
Media Attached
11:36
12m
Live Q&A
Empirical Study of Restarted and Flaky Builds on Travis CIMSR - Technical Paper
Technical Papers
Thomas Durieux KTH Royal Institute of Technology, Sweden, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Rui Abreu Instituto Superior Técnico, U. Lisboa & INESC-ID
DOI Pre-print Media Attached
11:48
12m
Live Q&A
LogChunks: A Data Set for Build Log AnalysisMSR - Data Showcase
Data Showcase
A: Carolin Brandt Delft University of Technology, A: Annibale Panichella Delft University of Technology, A: Andy Zaidman TU Delft, A: Moritz Beller Facebook, USA
Pre-print Media Attached
11:30 - 12:00
Registered Reports Track DiscussionRegistered Reports at MSR:Zoom2
Chair(s): Neil Ernst University of Victoria, Janet Siegmund TU Chemnitz

Open Discussion over Zoom (Joining info available on Slack)

11:30
30m
Other
Future Directions for Registered Reports MSR - Registered Reports
Registered Reports
Neil Ernst University of Victoria, Janet Siegmund TU Chemnitz
12:00 - 13:00
Code SmellsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Alessandro Garcia PUC-Rio

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

12:00
10m
Live Q&A
Detecting Video Game-Specific Bad Smells in Unity ProjectsMSR - Technical Paper
Technical Papers
Pre-print Media Attached
12:10
10m
Live Q&A
Investigating Severity Thresholds for Test SmellsMSR - Technical Paper
Technical Papers
Davide Spadini Delft University of Technology, Netherlands, Martin Schvarcbacher , Ana Maria Oprescu , Magiel Bruntink Software Improvement Group, Alberto Bacchelli University of Zurich
DOI Pre-print Media Attached
12:20
10m
Live Q&A
On the Prevalence, Impact, and Evolution of SQL code smells in Data-Intensive SystemsMSR - Technical Paper
Technical Papers
Biruk Asmare Muse , Masud Rahman Dalhousie University, Csaba Nagy Software Institute - USI, Lugano, Anthony Cleve University of Namur, Foutse Khomh Polytechnique Montréal, Giuliano Antoniol Polytechnique Montréal
Pre-print Media Attached
12:30
10m
Live Q&A
Multi-language Design Smells: A Backstage PerspectiveMSR - Registered Reports
Registered Reports
A: Mouna Abidi , A: Moses Openja , A: Foutse Khomh Polytechnique Montréal
Pre-print Media Attached
12:40
10m
Live Q&A
The Scent of Deep Learning Code: An Empirical StudyMSR - Technical Paper
Technical Papers
Hadhemi Jebnoun , Masud Rahman Dalhousie University, Foutse Khomh Polytechnique Montréal, Houssem Ben Braiek
Pre-print Media Attached
12:50
10m
Live Q&A
Developer-Driven Code Smell PrioritizationMSR - Technical Paper
Technical Papers
Fabiano Pecorelli University of Salerno, Fabio Palomba University of Salerno, Foutse Khomh Polytechnique Montréal, Andrea De Lucia University of Salerno
Pre-print Media Attached
12:00 - 13:00
MSR Mining ChallengeMining Challenge / Technical Papers at MSR:Zoom2
Chair(s): Antoine Pietri Inria, Diomidis Spinellis Athens University of Economics and Business, Stefano Zacchiroli Université de Paris and Inria

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

12:00
20m
Live Q&A
Cheating Death: A Statistical Survival Analysis of Publicly Available Python ProjectsMSR - Mining Challenge
Mining Challenge
A: Ali Rao Hamza , A: Chelsea Parlett-Pelleriti , A: Erik Linstead Chapman University
Pre-print Media Attached
12:20
20m
Live Q&A
An investigation to find motives behind cross-platform forks from Software Heritage datasetMSR - Mining Challenge
Mining Challenge
A: Avijit Bhattacharjee University of Saskatchewan, Canada, A: Sristy Sumana Nath Department of Computer Science, University of Saskatchewan, A: Shurui Zhou Carnegie Mellon University, USA / University of Toronto, CA, A: Debasish Chakroborti , A: Banani Roy University of Saskatchewan, A: Chanchal K. Roy University of Saskatchewan, A: Kevin Schneider University of Saskatchewan
DOI Pre-print Media Attached
12:40
20m
Live Q&A
Exploring the Security Awareness of the Python and JavaScript Open Source CommunitiesMSR - Mining Challenge
Mining Challenge
Gabor Antal , Márton Keleti , A: Peter Hegedus University of Szeged
Pre-print Media Attached
13:00 - 13:15
"Opening" & AwardsMSR Plenary at MSR:Zoom
Chair(s): Georgios Gousios Delft University of Technology, Sunghun Kim Hong Kong University of Science and Technology, Sarah Nadi University of Alberta

Live on YouTube: https://www.youtube.com/watch?v=Qvf7mHa-YYs

13:00
15m
Day opening
MSR Opening & Awards
MSR Plenary
Sunghun Kim Hong Kong University of Science and Technology, Sarah Nadi University of Alberta, Georgios Gousios Delft University of Technology
Media Attached
14:30 - 15:30
Bugs & IssuesTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Francisco Servant Virginia Tech

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

14:30
10m
Live Q&A
Dataset of Video Game Development ProblemsMSR - Data Showcase
Data Showcase
A: Cristiano Politowski Concordia University, Canada, A: Fabio Petrillo University of Quebec at Chicoutimi, A: Yann-Gaël Guéhéneuc Concordia University and Polytechnique Montréal, A: Gabriel Cavalheiro Ullmann UNIJUI - Universidade Regional do Noroeste do Estado do Rio Grande do Sul, A: Josias De Andrade Werly
Media Attached
14:40
10m
Live Q&A
On the Relationship between User Churn and Software IssuesMSR - Technical Paper
Technical Papers
Omar El Zarif , Daniel Alencar Da Costa University of Otago, Safwat Hassan Queens University, Kingston, Canada, Ying Zou Queen's University, Kingston, Ontario
Pre-print Media Attached
14:50
10m
Live Q&A
A Soft Alignment Model for Bug DeduplicationMSR - Technical Paper
Technical Papers
Pre-print Media Attached
15:00
10m
Live Q&A
A Large-Scale Comparative Evaluation of IR-Based Tools for Bug LocalizationMSR - Technical Paper
Technical Papers
Media Attached
15:10
10m
Live Q&A
How Often Do Single-Statement Bugs Occur? The ManySStuBs4J DatasetMSR - Data Showcase
Data Showcase
A: Rafael-Michael Karampatsis The University of Edinburgh, A: Charles Sutton Google Research
Pre-print Media Attached
15:20
10m
Live Q&A
Large-Scale Manual Validation of Bugfixing ChangesMSR - Registered Reports
Registered Reports
A: Steffen Herbold University of Göttingen, A: Alexander Trautsch University of Göttingen, A: Benjamin Ledel
Pre-print Media Attached
14:30 - 15:00
Tutorial 1: GDPR ConsiderationsEducation / Technical Papers at MSR:Zoom2
Chair(s): Abram Hindle University of Alberta, Alexander Serebrenik Eindhoven University of Technology

Q/A for tutorial (Joining info available on Slack)

14:30
30m
Tutorial
Mining Software Repositories While Respecting PrivacyMSR - Tutorial
Education
A: Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos
Pre-print Media Attached
16:30 - 17:30
Github & OSS DatasetsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Olga Baysal Carleton University

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

16:30
8m
Live Q&A
A New Dataset for Pull Request AcceptanceMSR - Data Showcase
Data Showcase
A: Xunhui Zhang National University of Defense Technology, China, A: Ayushi Rastogi University of Groningen, The Netherlands, A: Yue Yu College of Computer, National University of Defense Technology, Changsha 410073, China
Pre-print Media Attached
16:38
8m
Live Q&A
A Mixed Graph-Relational Dataset of Socio-technicalInteractions in Open Source SystemsMSR - Data Showcase
Data Showcase
A: Usman Ashraf , A: Christoph Mayr-Dorn Johannes Kepler University Linz, A: Alexander Egyed Johannes Kepler University, Linz, A: Sebastiano Panichella
Media Attached
16:47
8m
Live Q&A
A Complete Set of Related Git Repositories Identified via Community Detection Approaches Based on Shared CommitsMSR - Data Showcase
Data Showcase
A: Audris Mockus , A: Zoe Kotti Athens University of Economics and Business, A: Diomidis Spinellis Athens University of Economics and Business, A: Gabriel Dusing
Media Attached
16:55
8m
Live Q&A
A Dataset of Enterprise-Driven Open Source SoftwareMSR - Data Showcase
Data Showcase
A: Diomidis Spinellis Athens University of Economics and Business, A: Zoe Kotti Athens University of Economics and Business, A: Konstantinos Kravvaritis , A: Georgios Theodorou , A: Panos Louridas Athens University of Economics and Business
DOI Pre-print Media Attached
17:04
8m
Live Q&A
A Dataset for GitHub Repository DeduplicationMSR - Data Showcase
Data Showcase
A: Diomidis Spinellis Athens University of Economics and Business, A: Zoe Kotti Athens University of Economics and Business, A: Audris Mockus
DOI Pre-print Media Attached
17:12
8m
Live Q&A
A Dataset and an Approach for Identity Resolution of 38 Million Author IDs extracted from 2B Git CommitsMSR - Data Showcase
Data Showcase
A: Tanner Fry , A: Tapajit Dey , A: Andrey Karnauch University of Tennessee Knoxville, A: Audris Mockus
Pre-print Media Attached
17:21
8m
Live Q&A
20-MAD - 20 years of issues and commits of Mozilla and Apache DevelopmentMSR - Data Showcase
Data Showcase
A: Maëlick Claes University of Oulu, A: Mika Mäntylä University of Oulu
Media Attached
16:30 - 17:00
Platforms & DatasetsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom2
Chair(s): Moritz Beller Facebook, USA

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

16:30
7m
Live Q&A
RTPTorrent: An Open-source Dataset for Evaluating Regression Test PrioritizationMSR - Technical Paper
Technical Papers
Toni Mattis Hasso Plattner Institute, University of Potsdam, Patrick Rein Hasso Plattner Institute, Falco Dürsch , Robert Hirschfeld Hasso-Plattner-Institut (HPI), Germany
DOI Pre-print Media Attached
16:37
7m
Live Q&A
Polyglot and Distributed Software Repository Mining with CROSSFLOWMSR - Technical Paper
Technical Papers
Konstantinos Barmpis , Patrick Neubauer University of York, UK, Jonathan Co , Dimitris Kolovos University of York, Nicholas Matragkas , Richard Paige McMaster University
Media Attached
16:45
7m
Live Q&A
Boa Views: Easy Modularization and Sharing of MSR AnalysesMSR - Technical Paper
Technical Papers
Che Shian Hung , Robert Dyer University of Nebraska - Lincoln
Pre-print Media Attached
16:52
7m
Live Q&A
Determining the Intrinsic Structure of Public Software Development HistoryMSR - Registered Reports
Registered Reports
A: Antoine Pietri Inria, A: Guillaume Rousseau Université de Paris and Inria, A: Stefano Zacchiroli Université de Paris and Inria
Pre-print Media Attached

Tue 30 Jun

Displayed time zone: (UTC) Coordinated Universal Time change

10:30 - 11:00
EvolutionTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Jürgen Cito MIT

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

10:30
7m
Live Q&A
Capture the Feature Flag: Detecting Feature Flags in Open-SourceMSR - Technical Paper
Technical Papers
Jens Meinicke Carnegie Mellon University, Juan Hoyos Universidad Nacional de Colombia, Bogdan Vasilescu Carnegie Mellon University, Christian Kästner Carnegie Mellon University
Pre-print Media Attached
10:37
7m
Live Q&A
Forking Without Clicking: on How to Identify Software Repository ForksMSR - Technical Paper
Technical Papers
Antoine Pietri Inria, Guillaume Rousseau Université de Paris and Inria, Stefano Zacchiroli Université de Paris and Inria
Pre-print Media Attached
10:45
7m
Live Q&A
Visualization of Methods Changeability Based on VCS DataMSR - Technical Paper
Technical Papers
Sergey Svitkov , Timofey Bryksin JetBrains Research, Saint Petersburg State University
Pre-print Media Attached
10:52
7m
Live Q&A
Employing Contribution and Quality Metrics for Quantifying the Software Development ProcessMSR - Data Showcase
Data Showcase
A: Themistoklis Diamantopoulos Electrical and Computer Engineering Dept, Aristotle University of Thessaloniki, A: Michail Papamichail , A: Thomas Karanikiotis , A: Kyriakos Chatzidimitriou Aristotle University of Thessaloniki, A: Andreas Symeonidis Aristotle University of Thessaloniki
Pre-print Media Attached
10:30 - 11:00
Apps & BotsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom2
Chair(s): Ivano Malavolta Vrije Universiteit Amsterdam

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

10:30
7m
Live Q&A
AndroZooOpen: Collecting Large-scale Open Source Android Apps for the Research CommunityMSR - Data Showcase
Data Showcase
A: Pei Liu , A: Li Li Monash University, Australia, A: Yanjie Zhao , A: Xiaoyu Sun , A: John Grundy Monash University
Media Attached
10:37
7m
Live Q&A
Hall-of-Apps: The Top Android Apps Metadata ArchiveMSR - Data Showcase
Data Showcase
Media Attached
10:45
7m
Live Q&A
Detecting and Characterizing Bots that Commit CodeMSR - Technical Paper
Technical Papers
Tapajit Dey , Sara Mousavi , Eduardo Ponce University of Tennessee - Knoxville, Tanner Fry , Bogdan Vasilescu Carnegie Mellon University, Anna Filippova , Audris Mockus University of Tennessee - Knoxville
Pre-print Media Attached
10:52
7m
Live Q&A
Challenges in Chatbot Development: A Study of Stack Overflow PostsMSR - Technical Paper
Technical Papers
Ahmad Abdellatif Concordia University, Diego Costa Concordia University, Canada, Khaled Badran Concordia University, Rabe Abdalkareem Concordia University, Montreal, Canada, Emad Shihab Concordia University
Pre-print Media Attached
11:00 - 12:00
QualityTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Jens Krinke University College London

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

11:00
12m
Live Q&A
Beyond the Code: Mining Self-Admitted Technical Debt in Issue Tracker SystemsMSR - Technical Paper
Technical Papers
Laerte Xavier Universidade Federal de Minas Gerais (UFMG), Fabio da Silva Ferreira , Rodrigo Brito , Marco Tulio Valente Federal University of Minas Gerais, Brazil
Pre-print Media Attached
11:12
12m
Live Q&A
An Empirical Study on Regular Expression BugsMSR - Technical Paper
Technical Papers
Peipei Wang North Carolina State University, USA, Chris Brown North Carolina State University, Jamie Jennings North Carolina State University, Kathryn Stolee North Carolina State University
Pre-print Media Attached
11:24
12m
Live Q&A
Do Explicit Review Strategies Improve Code Review Performance?MSR - Registered Reports
Registered Reports
A: Pavlína Wurzel Gonçalves , A: Enrico Fregnan , A: Tobias Baum , A: Kurt Schneider Leibniz Universität Hannover, Software Engineering Group, A: Alberto Bacchelli University of Zurich
Pre-print Media Attached
11:36
12m
Live Q&A
SoftMon: A Tool to Compare Similar Open-source Software from a Performance PerspectiveMSR - Technical Paper
Technical Papers
Pre-print Media Attached
11:48
12m
Live Q&A
A Study of Potential Code Borrowing and License Violations in Java Projects on GitHubMSR - Technical Paper
Technical Papers
Yaroslav Golubev JetBrains Research, ITMO University, Maria Eliseeva , Nikita Povarov JetBrains, Timofey Bryksin JetBrains Research, Saint Petersburg State University
Pre-print Media Attached
11:00 - 12:00
SecurityData Showcase / Technical Papers at MSR:Zoom2
Chair(s): Dimitris Mitropoulos Athens University of Economics and Business

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

11:00
12m
Live Q&A
Did You Remember To Test Your Tokens?MSR - Technical Paper
Technical Papers
Danielle Gonzalez Rochester Institute of Technology, USA, Michael Rath Technische Universität Ilmenau, Mehdi Mirakhorli Rochester Institute of Technology
DOI Pre-print Media Attached
11:12
12m
Live Q&A
Automatically Granted Permissions in Android appsMSR - Technical Paper
Technical Papers
Paolo Calciati IMDEA Software Institute, Konstantin Kuznetsov Saarland University, CISPA, Alessandra Gorla IMDEA Software Institute, Andreas Zeller CISPA Helmholtz Center for Information Security
Media Attached
11:24
12m
Live Q&A
PUMiner: Mining Security Posts from Developer Question and Answer Websites with PU LearningMSR - Technical Paper
Technical Papers
Triet Le Huynh Minh The University of Adelaide, David Hin , Roland Croft , Muhammad Ali Babar The University of Adelaide
DOI Pre-print Media Attached
11:36
12m
Live Q&A
A C/C++ Code Vulnerability Dataset with Code Changes and CVE SummariesMSR - Data Showcase
Data Showcase
A: Jiahao Fan New Jersey Institute of Technology, USA, A: Yi Li New Jersey Institute of Technology, USA, A: Shaohua Wang New Jersey Institute of Technology, USA, A: Tien N. Nguyen University of Texas at Dallas
Media Attached
11:48
12m
Live Q&A
The Impact of a Major Security Event on an Open Source Project: The Case of OpenSSLMSR - Technical Paper
Technical Papers
James Walden Northern Kentucky University
Pre-print Media Attached
14:00 - 15:00
ML4SETechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Kevin Moran William & Mary/George Mason University

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

14:00
12m
Live Q&A
A Machine Learning Approach for Vulnerability CurationACM SIGSOFT Distinguished Paper AwardMSR - Technical Paper
Technical Papers
Chen Yang Veracode, Inc., Andrew Santosa Veracode, Inc., Ang Ming Yi , Abhishek Sharma Singapore Management University, Singapore, Asankhaya Sharma Veracode, Inc., David Lo Singapore Management University
Pre-print Media Attached
14:12
12m
Live Q&A
Embedding Java Classes with code2vec: Improvements from Variable ObfuscationMSR - Technical Paper
Technical Papers
Rhys Compton University of Waikato, Eibe Frank Department of Computer Science, University of Waikato, Panos Patros , Abigail Koay University of Waikato
DOI Pre-print Media Attached
14:24
12m
Live Q&A
A Study on the Accuracy of OCR Engines for Source Code Transcription from Programming ScreencastsMSR - Technical Paper
Technical Papers
Abdulkarim Malkadi Florida State University, USA - Jazan University, KSA, Mohammad Alahmadi Florida State University, Sonia Haiduc Florida State University
Pre-print Media Attached
14:36
12m
Live Q&A
What is the Vocabulary of Flaky Tests?MSR - Technical Paper
Technical Papers
Gustavo Pinto UFPA, Breno Miranda Federal University of Pernambuco, Supun Dissanayake The University of Adelaide, Marcelo d'Amorim Federal University of Pernambuco, Christoph Treude The University of Adelaide, Antonia Bertolino CNR-ISTI
Pre-print Media Attached
14:48
12m
Live Q&A
Improved Automatic Summarization of Subroutines via Attention to File ContextMSR - Technical Paper
Technical Papers
Sakib Haque University of Notre Dame, Alexander LeClair University Of Notre Dame, Lingfei Wu IBM Research, Collin McMillan University of Notre Dame
Pre-print Media Attached
16:00 - 17:00
Developer CollaborationTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom
Chair(s): Bogdan Vasilescu Carnegie Mellon University

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

16:00
10m
Live Q&A
Need for tweet. How open-source developers use Twitter to talk about their GitHub workMSR - Technical Paper
Technical Papers
Pre-print Media Attached
16:10
10m
Live Q&A
Can We Use SE-specific Sentiment Analysis Tools in a Cross-Platform Setting?MSR - Technical Paper
Technical Papers
Nicole Novielli University of Bari, Fabio Calefato University of Bari, Davide Dongiovanni University of Bari, Daniela Girardi University of Bari, Filippo Lanubile University of Bari
DOI Pre-print Media Attached
16:20
10m
Live Q&A
GitterCom: A Dataset of Open Source Developer Communications in GitterMSR - Data Showcase
Data Showcase
A: Esteban Parra Florida State University, A: Ashley Ellis , A: Sonia Haiduc Florida State University
Pre-print Media Attached
16:30
10m
Live Q&A
The Impact of Dynamics of Collaborative Software Engineering on Introverts: A Study ProtocolMSR - Registered Reports
Registered Reports
A: Ingrid Nunes Universidade Federal do Rio Grande do Sul (UFRGS), Brazil, A: Christoph Treude The University of Adelaide, A: Fabio Calefato University of Bari
Pre-print Media Attached
16:40
10m
Live Q&A
Software-related Slack Chats with Disentangled ConversationsMSR - Data Showcase
Data Showcase
A: Preetha Chatterjee University of Delaware, USA, A: Kostadin Damevski Virginia Commonwealth University, A: Nicholas A. Kraft UserVoice, A: Lori Pollock
Pre-print Media Attached
16:50
10m
Live Q&A
Traceability Support for Multi-Lingual Software ProjectsACM SIGSOFT Distinguished Paper AwardMSR - Technical Paper
Technical Papers
Yalin Liu University of Notre Dame, Jinfeng Lin University of Notre Dame, Jane Cleland-Huang University of Notre Dame
Media Attached
16:00 - 17:00
Visions & ReflectionsTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom2
Chair(s): Venera Arnaoudova Washington State University

Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack)

16:00
15m
Live Q&A
The State of the ML-universe: 10 Years of Artificial Intelligence & Machine Learning Software Development on GitHubMSR - Technical Paper
Technical Papers
Danielle Gonzalez Rochester Institute of Technology, USA, Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research
DOI Pre-print Media Attached
16:15
15m
Live Q&A
Ethical Mining – A Case Study on MSR Mining ChallengesACM SIGSOFT Distinguished Paper AwardMSR - Technical Paper
Technical Papers
Nicolas Gold University College London, Jens Krinke University College London
DOI Pre-print Media Attached
16:30
15m
Live Q&A
From Innovations to Prospects: What Is Hidden Behind Cryptocurrencies?MSR - Technical Paper
Technical Papers
Ang Jia Xi'an Jiaotong University, Ming Fan Xi'an Jiaotong University, Xi Xu , Di Cui Xi'an Jiaotong University, Wenying Wei , Zijiang Yang Western Michigan University, Kai Ye , Ting Liu Xi'an Jiaotong University
DOI Pre-print Media Attached
16:45
15m
Live Q&A
What constitutes Software? An Empirical, Descriptive Study of ArtifactsMSR - Technical Paper
Technical Papers
Pre-print Media Attached

Call for Registrations

Call for Registrations: MSR/EMSE Registered Reports

EMSE, in conjunction with the conference on Mining Software Repositories (MSR), is conducting a pilot RR track.

See the associated Author’s Guide. Please email the MSR track chairs - Neil Ernst or Janet Siegmund - for any questions, clarifications, or comments.

What are Registered Reports

  • Methods and proposed analyses are pre-registered and reviewed prior to research being conducted.
  • Reduce/eliminate under-powered, selectively reported, researcher-biased studies.

Two Phase Review

  • (MSR 2020) Phase 1: Introduction, Methods (including proposed analyses), and Pilot Data (where applicable). In Principle Acceptance.
  • (EMSE) Phase 2: full study, after data collection and analysis. Results may be negative!

Additional exploratory analyses in Phase 2 may be conducted, if they are justified. Any deviation from the protocol must be justified and logged in detail to ensure replicability. EMSE J. Editors reserve the right to tighten eligibility criteria if necessary.

Phase 1 Criteria

  • Importance of the research question(s).
  • Logic, rationale, and plausibility of the proposed hypotheses.
  • Soundness and feasibility of the methodology and analysis pipeline (including statistical power analysis where appropriate).
  • Clarity and degree of methodological detail for replication.
  • Will results obtained test the stated hypotheses?

Phase 2 Criteria (via https://osf.io/pukzy/)

  • Whether the data are able to test the authors’ proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls)
  • Whether the Introduction, rationale and stated hypotheses are the same as the approved Stage 1submission (required)
  • Whether the authors adhered precisely to the registered experimental procedures
  • Whether any unregistered post hoc analyses added by the authors are justified, methodologically sound, and informative
  • Whether the authors’ conclusions are justified given the data

Qualitative Research and RR

  • No reason to assume pre-registration cannot be for qualitative methods such as card-sorting, grounded theory, coding, member checking etc.
  • E.g. phase 1 may include details on survey respondents, survey instrument design, data collection techniques.
  • OSF Qualitative Pre-Registration

Organizers

Publicity

  • Norman Peitek

Program Committee

See sidebar.

Timeline

DateMilestone
January 10, 2020 study protocols and plans due
January 31, 2020 initial protocol reviews
February 14, 2020 rebuttals/clarifications due
March 2, 2020 In Principle Acceptance (IPA) decision notifications
March 16, 2020 summary plan / camera-ready
March 31, 2020Phase 1 Reports registered with OSF registry
tbd Phase 2 submitted to EMSE (deadline to be determined)

Submissions

Submit via EasyChair. EasyChair will be used to handle Phase 1 reviews and feedback/rebuttal. EMSE’s EditorialManager system will be used for the Phase 2 submissions, with OSF managing the registration. Reviews from Phase 1 will be shared with the Phase 2 reviewers.

Submission Details

Submissions should follow the ACM Conference Proceedings Formatting Guidelines. LaTeX users must use the provided acmart.cls and ACM-Reference-Format.bst without modification, enable the conference format in the preamble of the document (i.e., \documentclass[sigconf,review]{acmart}), and use the ACM reference format for the bibliography (i.e., \bibliographystyle{ACM-Reference-Format}). The review option adds line numbers, thereby allowing referees to refer to specific lines in their comments.

Follow the template requested in the author’s guide to MSR RR submissions.

Page limit for MSR is 4 pages including references.

Review will be unblinded or single blind. There will be a light-weight rebuttal phase, in which authors have the opportunity to clarify unclear parts of the report. However, the rebuttal is not there to make changes to the experimental design.

FAQ

Q. How will self-plagiarism be handled?
A. Self-plagiarism is where an author includes verbatim text from other, already published work. We expect this to be managed using the existing workshop/extension model; there will be sufficient new content in Phase 2 to clearly indicate this is a new piece of work.

Q. What if I publish my Phase 1 proposal, and then someone scoops me by following the protocol?
A. In practice, this seems quite uncommon. However, OSF has mechanisms to manage embargo periods, so this might be something we also consider in the future. Currently the MSR/EMSE model makes embargos impractical. However, tracks such as “new ideas” already pose this potential risk, so we don’t anticipate extensive problems.

Q. How does this process deal with exploratory studies, where there is no well-defined hypothesis?
A. For now, we strongly suggest such studies target the New Ideas and Emerging Results Track of MSR: . We will focus on studies that have a clear, well-formulated hypothesis.

Q. What if my study changes as I gather data?
A. RR have flexibility to deviate from the analysis plan. However, authors will need to provide solid reasons as to why they deviated from the plan.

Other FAQs on RR in general are at the bottom of the OSF page.

Links

  1. https://cos.io/prereg/
  2. See these links

NB: Please contact the MSR RR track chairs with any questions, feedback, or requests for clarification. Specific analysis approaches mentioned below are intended as examples, not mandatory components.

Title (required)

Provide the working title of your study. It may be the same title that you submit for publication of your final manuscript, but it is not a requirement.

  • Example: Should your family travel with you on the enterprise?
  • Subtitle (optional): Effect of accompanying families on the work habits of crew members

Authors (required)

At this stage, we believe that an unblinded/single blind review is most productive

Structured Abstract (required)

The abstract should describe in 200 words or so:

Background/Context

What is your research about? Why are you doing this research, why is it interesting?

Example: The enterprise is the flag ship of the federation, and it allows families to travel onboard. However, there are no studies that evaluate how this affects the crew members.”

Objective/Aim

What exactly are you studying/investigating/evaluating? What are the objects of the study?

We welcome both confirmatory and exploratory types of studies.

Example: We evaluate whether the frequency of sick days, the work effectiveness and efficiency differ between science officers who bring their family with them, compared to science officers who are serving without their family.

Example: We investigate the problem of frequent Holodeck use on interpersonal relationships with an ethnographic study using participant observation, in order to derive specific hypotheses about Holodeck usage.

Method

How are you addressing your objective? What data sources are you using.

Example: We conduct an observational study and use a between subject design. To analyze the data, we use a t test or Wilcoxon test, depending on the underlying distribution. Our data come computer monitoring of Enterprise crew members.

Limitations

Hypotheses / research questions (required)

Clearly state the research hypotheses that you want to test with your study, and a rationalization for the hypotheses.

  • Example: Science officers with their family on board have more sick days than science officers without their family

  • Rationale: Since toddlers are often sick, we can expect that crew members with their family onboard need to take sick days more often.

Introduction

Give more details on the bigger picture of your study and how it contributes to this bigger picture. An important component pf phase 1 review is assessing the importance and relevance of the study questions, so be sure to explain this.

Variables (required)

  • Independent Variable(s) and their operationalization
  • Dependent Variable(s) and their operationalization (e.g., time to solve a specified task)
  • Confounding Variable(s) and how their effect will be controlled (e.g., species type (Vulcan, Human, Tribble) might be a confounding factor; we control for it by separating our sample additionally into Human/Non-Human and using an ANOVA (normal distribution) or Friedman (non-normal distribution) to distill its effect).

For each variable, you should give: - name (e.g., presence of family) - abbreviation (if you intend to use one) - description (whether the family of the crew members travels on board) - scale type (nominal: either the family is present or not) - operationalization (crew members without family on board vs. crew members with family onboard)

Material/objects (required)

Describe any material that you plan to use, be specific on whether you developed it (and how) or whether it is already defined (e.g., a standard myers-briggs-type indicator)

Example: For sick days, we recruit the medical records from sick bay (ethics approval pending). For efficiency, we conduct standard interviews with the superior officer and crew members. The questions are the following: / can be found on the Web site / Appendix. Furthermore, we observe their performance during a simulated task.

Tasks (optional)

If you use tasks, describe them, how they were designed or from where they are taken and why they are suitable to evaluate the hypotheses / research question

Example: For effectiveness of the crew members, we ask them to sweep a class 2 nebula. We simulate an error in the primary sensory array. Crew members should then run a level 3 diagnostic to spot the error, fix the error, and complete the sweep of the nebular. We measure the time to (i) spot that there is an error, (ii) decide on the correct diagnostic protocol, (iii) fix the error, and (iv) complete the sweep.

Participants/Subjects/sample (required)

Describe how and why you select the sample. When you conduct a meta analysis, describe the primary studies / work on which you base your meta analysis.

Example: We recruit crew members from the science department on a voluntary basis. They are our targeted population.

Execution Plan (required)

Describe the experimental protocol.

Example: Each crew member needs to sign the informed consent and agreement to process their data according to GDPR. Then, we conduct the interviews. Afterwards, participants need to complete the simulated task.

Analysis Plan (required)

Descriptive statistics

How do you describe the data? How do you handle outliers?

Example: To represent the number of sickdays, we use histograms. Dependending on the distribution, we remove values that are 2 standard deviations above the mean as outliers (normal distribution). If the data are non-normal, we use the median and values below the 10th/above the 90th percentile.

How do you evaluate the practical significance of the hypotheses?

How are you testing the significance of your results? Be specific about the epistemological paradigm and statistical paradigm you are using. This will help us assign reviewers familiar with the relevant research strategies. See Neto et al. for more information.

  • Example: (Frequentist) To test for normality, we use a Shapiro-Wilk test. For efficiency, we use a t test / Wilcoxon test depending on the distribution. To evaluate the effect of species type, we use a two-way ANOVA / Friedman test, depending on the distribution.
  • Example: (Bayesian) We derive a posterior predictive distribution by choosing a weakly informative prior with sickdays modeled using a Poisson distribution, and likelihood of species influence modeled using a normal distribution with mean 0 and s.d. \sigma. We then calculate the 95% and 99% uncertainty intervals and median m and mean μ of the posterior.

Examples