The International Conference on Mining Software Repositories (MSR) has hosted a mining challenge since 2006. With this challenge, we call upon everyone interested to apply their tools to a common dataset. The challenge is for researchers and practitioners to bravely use their mining tools and approaches on a dare. Right now, there is a call for challenge proposals. See the CFP for more details. The current important dates are:
- Deadline for proposals: Monday July 22, 2019
- Proposal accepted and all submitters notified: Monday August 12th, 2019
- Challenge CFP + data made available: Friday August 30, 2019
- Challenge PC formed: Friday September 13th, 2019
- Challenge papers deadline: Thursday Feb 13th, 2020 (tentative)
Mon 29 JunDisplayed time zone: (UTC) Coordinated Universal Time change
11:00 - 12:00 | Build, CI, & DependenciesTechnical Papers / Registered Reports / Keynote / MSR Awards / FOSS Award / Education / Data Showcase / Mining Challenge / MSR Challenge Proposals / Ask Me Anything at MSR:Zoom Chair(s): Raula Gaikovina Kula NAIST Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack) | ||
11:00 12mLive Q&A | A Tale of Docker Build Failures: A Preliminary StudyMSR - Technical Paper Technical Papers Yiwen Wu National University of Defense Technology, Yang Zhang National University of Defense Technology, China, Tao Wang National University of Defense Technology, Huaimin Wang Pre-print Media Attached | ||
11:12 12mLive Q&A | Using Others' Tests to Avoid Breaking UpdatesMSR - Technical Paper Technical Papers Suhaib Mujahid Concordia University, Rabe Abdalkareem Concordia University, Montreal, Canada, Emad Shihab Concordia University, Shane McIntosh McGill University Pre-print Media Attached | ||
11:24 12mLive Q&A | A Dataset of DockerfilesMSR - Data Showcase Data Showcase A: Jordan Henkel University of Wisconsin–Madison, A: Christian Bird Microsoft Research, A: Shuvendu K. Lahiri Microsoft Research, A: Thomas Reps University of Wisconsin-Madison, USA Media Attached | ||
11:36 12mLive Q&A | Empirical Study of Restarted and Flaky Builds on Travis CIMSR - Technical Paper Technical Papers Thomas Durieux KTH Royal Institute of Technology, Sweden, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Rui Abreu Instituto Superior Técnico, U. Lisboa & INESC-ID DOI Pre-print Media Attached | ||
11:48 12mLive Q&A | LogChunks: A Data Set for Build Log AnalysisMSR - Data Showcase Data Showcase A: Carolin Brandt Delft University of Technology, A: Annibale Panichella Delft University of Technology, A: Andy Zaidman TU Delft, A: Moritz Beller Facebook, USA Pre-print Media Attached | ||
Tue 30 JunDisplayed time zone: (UTC) Coordinated Universal Time change
11:00 - 12:00 | SecurityData Showcase / Technical Papers at MSR:Zoom2 Chair(s): Dimitris Mitropoulos Athens University of Economics and Business Q/A & Discussion of Session Papers over Zoom (Joining info available on Slack) | ||
11:00 12mLive Q&A | Did You Remember To Test Your Tokens?MSR - Technical Paper Technical Papers Danielle Gonzalez Rochester Institute of Technology, USA, Michael Rath Technische Universität Ilmenau, Mehdi Mirakhorli Rochester Institute of Technology DOI Pre-print Media Attached | ||
11:12 12mLive Q&A | Automatically Granted Permissions in Android appsMSR - Technical Paper Technical Papers Paolo Calciati IMDEA Software Institute, Konstantin Kuznetsov Saarland University, CISPA, Alessandra Gorla IMDEA Software Institute, Andreas Zeller CISPA Helmholtz Center for Information Security Media Attached | ||
11:24 12mLive Q&A | PUMiner: Mining Security Posts from Developer Question and Answer Websites with PU LearningMSR - Technical Paper Technical Papers Triet Le The University of Adelaide, David Hin , Roland Croft , Muhammad Ali Babar The University of Adelaide DOI Pre-print Media Attached | ||
11:36 12mLive Q&A | A C/C++ Code Vulnerability Dataset with Code Changes and CVE SummariesMSR - Data Showcase Data Showcase A: Jiahao Fan New Jersey Institute of Technology, USA, A: Yi Li New Jersey Institute of Technology, USA, A: Shaohua Wang New Jersey Institute of Technology, USA, A: Tien N. Nguyen University of Texas at Dallas Media Attached | ||
11:48 12mLive Q&A | The Impact of a Major Security Event on an Open Source Project: The Case of OpenSSLMSR - Technical Paper Technical Papers James Walden Northern Kentucky University Pre-print Media Attached | ||
Call for Challenge Proposals
One of the secret ingredients behind the success of the International Conference on Mining Software Repositories (MSR) is its annual Mining Challenge, in which MSR participants can showcase their techniques, tools and creativity on a common data set. In true MSR fashion, this data set is a “real” data set contributed by researchers in the community, solicited through an open call.
There are many benefits of sharing a data set for the MSR Mining Challenge. The selected challenge proposal explaining the data set will appear in the MSR 2020 proceedings, and the challenge papers using the data set will be required to cite the challenge proposal or an existing paper of the researchers about the selected data set. Furthermore, the authors of the data set will become the official 2020 Mining Challenge Chairs, responsible for the reviewing process (e.g., composing a Challenge PC, managing the submissions and review assignments, etc.). Finally, it is not uncommon for challenge data sets to be featured in MSR papers and other conference publications well after the conference is finished!
If you would like to compete for a chance to have your data set featured in the 2020 MSR Mining Challenge and all the benefits that come with it, please submit a 1-page proposal with up to 3 pages of appendix containing the following information:
- Title of data set.
- What does your data set contain?
- How large is it?
- How accessible is it and how can the data be obtained?
- How representative is it?
- Does it require specialized tools to process it?
- What would challenge participants need to work with the data set?
- What kind of questions do you expect challenge participants to answer?
- A link to a small sample of the data (e.g., via dropbox, github, etc.).
The above submissions should use the ACM template (https://www.acm.org/publications/proceedings-template for both LaTeX and Word users). LaTeX users must use the provided acmart.clsand ACM-Reference-Format.bst without modification, enable the conference format in the preamble of the document (i.e., \documentclass[sigconf,review]{acmart}), and use the ACM reference format for the bibliography (i.e., \bibliographystyle{ACM-Reference-Format}). The review option adds line numbers, thereby allowing referees to refer to specific lines in their comments. Submissions will be examined and discussed by the MSR 2020 PC chairs, General Chair, and potentially steering committee members in case of conflicts of interest.
Once the winning proposal is selected, its authors will become the MSR 2020 Challenge Chairs and will be responsible for choosing the MSR 2020 Mining Challenge program committee. The major deadline for having all material related to the selected challenge available on the MSR 2020 website is Friday August 30th 2019. At that time, the Challenge CFP will be announced and the full challenge data set will be publicly released. Two more weeks, until Friday September 13th, will be allowed to find the Challenge PC members. By making the challenge data set available before the Fall term starts, we hope that many student teams will be able to use the challenge data set for their graduate class projects.
Timeline:
All dates are AOE
- Deadline for proposals: Monday July 22, 2019
- Proposal accepted and all submitters notified: Monday August 12th, 2019
- Challenge CFP + data made available: Friday August 30, 2019
- Challenge PC formed: Friday September 13th, 2019
- Challenge papers deadline: Thursday Feb 13th, 2019 (tentative)
MSR 2019 Organization/Proposal Reviewers:
- General Chair: Sung Kim, Hong Kong University of Science and Technology
- PC Co-Chair: Georgios Gousios, Delft University of Technology
- PC Co-Chair: Sarah Nadi, University of Alberta
Open Challenge Submission Web Site:
All challenge proposals should be submitted through EasyChair https://easychair.org/conferences/?conf=msr20. Please select the “MSR 2020 Challenge Proposals” track when submitting.