Using screenshot attachments in issue reports for triaging

Aktaş, Ethem Utku and Yılmaz, Cemal (2022) Using screenshot attachments in issue reports for triaging. Empirical Software Engineering, 27 (7). ISSN 1382-3256 (Print) 1573-7616 (Online)

Full text not available from this repository. (Request a copy)


In previous work, we deployed IssueTAG, which uses the one-line summary and the description fields of the issue reports to automatically assign them to the stakeholders, who are responsible for resolving the reported issues. Since its deployment on January 12, 2018 at Softtech – the software subsidiary of the largest private bank in Turkey, IssueTAG has made a total of 301,752 assignments (as of November 2021). One observation we make is that a large fraction of the issue reports submitted to Softtech has screenshot attachments and, in the presence of such attachments, the reports often convey less information in their one-line summary and the description fields, which tends to reduce the assignment accuracy. In this work, we use the screenshot attachments as an additional source of information to further improve the assignment accuracy, which, to the best of our knowledge, has not been studied before for automatic issue assignments. In particular, we develop a number of multi-source assignment models, which use both the issue reports and the screenshot attachments, as well as a number of single source models, which use either the issue reports or the screenshot attachments, and empirically evaluate them on real issue reports. Compared to the currently deployed single-source model in the field, the best multi-source model improved the assignment accuracy from 0.848 to 0.855 at an acceptable overhead cost, reducing the overall 3.3 percentage-point deficit between the human triagers and the deployed system by 0.7 points.
Item Type: Article
Uncontrolled Keywords: Issue triaging; Issule report assignment; Optical character recognition; Support vector machines; Text classification
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Cemal Yılmaz
Date Deposited: 25 Mar 2023 15:25
Last Modified: 25 Mar 2023 15:25

Actions (login required)

View Item
View Item