Automated issue assignment: results and insights from an industrial case

Aktas, Ethem Utku and Yılmaz, Cemal (2020) Automated issue assignment: results and insights from an industrial case. Empirical Software Engineering, 25 (5). pp. 3544-3589. ISSN 1382-3256 (Print) 1573-7616 (Online)

This is the latest version of this item.

Full text not available from this repository. (Request a copy)

Abstract

We automate the process of assigning issue reports to development teams by using data mining approaches and share our experience gained by deploying the resulting system, called IssueTAG, at Softtech. Being a subsidiary of the largest private bank in Turkey, Softtech on average receives 350 issue reports daily from the field, which need to be handled with utmost importance and urgency. IssueTAG has been making all the issue assignments at Softtech since its deployment on Jan 12, 2018. Deploying IssueTAG presented us not only with an unprecedented opportunity to observe the practical effects of automated issue assignment, but also with an opportunity to carry out user studies, both of which (to the best of our knowledge) have not been done before in this context. We first empirically determine the data mining approach to be used in IssueTAG. We then deploy IssueTAG and make a number of valuable observations. First, it is not just about deploying a system for automated issue assignment, but also about designing/changing the assignment process around the system. Second, the accuracy of the assignments does not have to be higher than that of manual assignments in order for the system to be useful. Third, deploying such a system requires the development of additional functionalities, such as creating human-readable explanations for the assignments and detecting deteriorations in assignment accuracies, for both of which we have developed and empirically evaluated different approaches. Last but not least, stakeholders do not necessarily resist change and gradual transition helps build confidence.
Item Type: Article
Uncontrolled Keywords: Accountable machine learning; Bug triaging; Change point detection; Issue report assignment; Text classification
Divisions: Faculty of Engineering and Natural Sciences
Depositing User: Cemal Yılmaz
Date Deposited: 02 Aug 2023 11:34
Last Modified: 02 Aug 2023 11:34
URI: https://research.sabanciuniv.edu/id/eprint/46784

Available Versions of this Item

Actions (login required)

View Item
View Item