Automated issue assignment: results and insights from an industrial case

Aktaş, Ethem Utku and Yılmaz, Cemal (2020) Automated issue assignment: results and insights from an industrial case. Empirical Software Engineering . ISSN 1382-3256 (Print) 1573-7616 (Online) Published Online First http://dx.doi.org/10.1007/s10664-020-09846-3

Warning
There is a more recent version of this item available.
[thumbnail of EmpiricalSE-BugTriaging-2020.pdf] PDF
EmpiricalSE-BugTriaging-2020.pdf
Restricted to Registered users only

Download (1MB) | Request a copy

Abstract

We automate the process of assigning issue reports to development teams by using data mining approaches and share our experience gained by deploying the resulting system, calledIssueTAG, atSofttech. Being a subsidiary of the largest private bank in Turkey, Softtech on average receives 350 issue reports daily from the field, which need to be handled with utmost importance and urgency. IssueTAG has been making all the issue assignments at Softtech since its deployment on Jan 12, 2018. Deploying IssueTAG presented us not only with an unprecedented opportunity to observe the practical effects of automated issue assignment, but also with an opportunity to carry out user studies, both of which (to the best of our knowledge) have not been done before in this context. We first empirically determine the data mining approach to be used in IssueTAG. We then deploy IssueTAG and make a number of valuable observations. First, it is not just about deploying a system for automated issue assignment, but also about designing/changing the assignment process around the system. Second, the accuracy of the assignments does not have to be higher than that of manual assignments in order for the system to be useful. Third, deploying such a system requires the development of additional functionalities, such as creating human-readable explanations for the assignments and detecting deteriorations in assignment accuracies, for both of which we have developed and empirically evaluated different approaches. Last but not least, stakeholders do not necessarily resist change and gradual transition helps build confidence.
Item Type: Article
Uncontrolled Keywords: Bug triaging; Issue report assignment; Text classification; Accountable machine learning; Change point detection
Subjects: Q Science > Q Science (General)
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Cemal Yılmaz
Date Deposited: 21 Sep 2020 18:28
Last Modified: 21 Sep 2020 18:28
URI: https://research.sabanciuniv.edu/id/eprint/40545

Available Versions of this Item

Actions (login required)

View Item
View Item