Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction

Muhammed Kadir Yucel; Ayse Tosun

doi:10.1109/UBMK55850.2022.9919454

Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction

Muhammed Kadir Yucel, Ayse Tosun

Department of Computer Engineering

Istanbul Technical University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

In software projects, bug reports remain open and get updates from team members during the related bug's lifetime. It is an important task to predict when a bug would be resolved so that managers plan timeline and allocate team resources accordingly. Prior works show that reporter information is the most effective feature for predicting resolution time. Previous work only considers bug reporting activity to define reporter reputation and misses other activities. In this paper, we propose a new reputation calculation method that considers all activities of a reporter within a bug tracking system. We collected bug reports of Chromium and WebRTC projects and calculated reputations of each bug reporter within the dataset using our weighted, activity based calculation method as well as other methods from previous work in order to compare performance. We trained a Doc2Vec model to utilize textual information in bug reports to build a base model for comparing different reputation methods. Bug reports are classified into two categories as FAST and SLOW according to their resolution time. Stochastic Gradient Descent (SGD) and Extreme Gradient Boost (XGB) classifier algorithms are employed. XGB classifier resulted with 55 % - 72 % F -Scores for FAST and SLOW respectively. The results also show that data characteristics of project affects the effectiveness of the reputation calculation method on bug resolution time prediction.

Original language	English
Title of host publication	Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	110-115
Number of pages	6
ISBN (Electronic)	9781665470100
DOIs	https://doi.org/10.1109/UBMK55850.2022.9919454
Publication status	Published - 2022
Event	7th International Conference on Computer Science and Engineering, UBMK 2022 - Diyarbakir, Turkey Duration: 14 Sept 2022 → 16 Sept 2022

Publication series

Name	Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022

Conference

Conference	7th International Conference on Computer Science and Engineering, UBMK 2022
Country/Territory	Turkey
City	Diyarbakir
Period	14/09/22 → 16/09/22

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Keywords

bug resolution time prediction
document embedding
reporter reputation

Access to Document

10.1109/UBMK55850.2022.9919454

Cite this

Yucel, M. K., & Tosun, A. (2022). Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction. In Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022 (pp. 110-115). (Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/UBMK55850.2022.9919454

Yucel, Muhammed Kadir ; Tosun, Ayse. / Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction. Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 110-115 (Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022).

@inproceedings{6c36d28c4b4147a39c52f291881e1b12,

title = "Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction",

abstract = "In software projects, bug reports remain open and get updates from team members during the related bug's lifetime. It is an important task to predict when a bug would be resolved so that managers plan timeline and allocate team resources accordingly. Prior works show that reporter information is the most effective feature for predicting resolution time. Previous work only considers bug reporting activity to define reporter reputation and misses other activities. In this paper, we propose a new reputation calculation method that considers all activities of a reporter within a bug tracking system. We collected bug reports of Chromium and WebRTC projects and calculated reputations of each bug reporter within the dataset using our weighted, activity based calculation method as well as other methods from previous work in order to compare performance. We trained a Doc2Vec model to utilize textual information in bug reports to build a base model for comparing different reputation methods. Bug reports are classified into two categories as FAST and SLOW according to their resolution time. Stochastic Gradient Descent (SGD) and Extreme Gradient Boost (XGB) classifier algorithms are employed. XGB classifier resulted with 55 % - 72 % F -Scores for FAST and SLOW respectively. The results also show that data characteristics of project affects the effectiveness of the reputation calculation method on bug resolution time prediction.",

keywords = "bug resolution time prediction, document embedding, reporter reputation",

author = "Yucel, {Muhammed Kadir} and Ayse Tosun",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 7th International Conference on Computer Science and Engineering, UBMK 2022 ; Conference date: 14-09-2022 Through 16-09-2022",

year = "2022",

doi = "10.1109/UBMK55850.2022.9919454",

language = "English",

series = "Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "110--115",

booktitle = "Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022",

address = "United States",

}

Yucel, MK & Tosun, A 2022, Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction. in Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022. Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022, Institute of Electrical and Electronics Engineers Inc., pp. 110-115, 7th International Conference on Computer Science and Engineering, UBMK 2022, Diyarbakir, Turkey, 14/09/22. https://doi.org/10.1109/UBMK55850.2022.9919454

Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction. / Yucel, Muhammed Kadir; Tosun, Ayse.
Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 110-115 (Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction

AU - Yucel, Muhammed Kadir

AU - Tosun, Ayse

PY - 2022

Y1 - 2022

N2 - In software projects, bug reports remain open and get updates from team members during the related bug's lifetime. It is an important task to predict when a bug would be resolved so that managers plan timeline and allocate team resources accordingly. Prior works show that reporter information is the most effective feature for predicting resolution time. Previous work only considers bug reporting activity to define reporter reputation and misses other activities. In this paper, we propose a new reputation calculation method that considers all activities of a reporter within a bug tracking system. We collected bug reports of Chromium and WebRTC projects and calculated reputations of each bug reporter within the dataset using our weighted, activity based calculation method as well as other methods from previous work in order to compare performance. We trained a Doc2Vec model to utilize textual information in bug reports to build a base model for comparing different reputation methods. Bug reports are classified into two categories as FAST and SLOW according to their resolution time. Stochastic Gradient Descent (SGD) and Extreme Gradient Boost (XGB) classifier algorithms are employed. XGB classifier resulted with 55 % - 72 % F -Scores for FAST and SLOW respectively. The results also show that data characteristics of project affects the effectiveness of the reputation calculation method on bug resolution time prediction.

AB - In software projects, bug reports remain open and get updates from team members during the related bug's lifetime. It is an important task to predict when a bug would be resolved so that managers plan timeline and allocate team resources accordingly. Prior works show that reporter information is the most effective feature for predicting resolution time. Previous work only considers bug reporting activity to define reporter reputation and misses other activities. In this paper, we propose a new reputation calculation method that considers all activities of a reporter within a bug tracking system. We collected bug reports of Chromium and WebRTC projects and calculated reputations of each bug reporter within the dataset using our weighted, activity based calculation method as well as other methods from previous work in order to compare performance. We trained a Doc2Vec model to utilize textual information in bug reports to build a base model for comparing different reputation methods. Bug reports are classified into two categories as FAST and SLOW according to their resolution time. Stochastic Gradient Descent (SGD) and Extreme Gradient Boost (XGB) classifier algorithms are employed. XGB classifier resulted with 55 % - 72 % F -Scores for FAST and SLOW respectively. The results also show that data characteristics of project affects the effectiveness of the reputation calculation method on bug resolution time prediction.

KW - bug resolution time prediction

KW - document embedding

KW - reporter reputation

UR - http://www.scopus.com/inward/record.url?scp=85141846731&partnerID=8YFLogxK

U2 - 10.1109/UBMK55850.2022.9919454

DO - 10.1109/UBMK55850.2022.9919454

M3 - Conference contribution

AN - SCOPUS:85141846731

T3 - Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022

SP - 110

EP - 115

BT - Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 7th International Conference on Computer Science and Engineering, UBMK 2022

Y2 - 14 September 2022 through 16 September 2022

ER -

Yucel MK, Tosun A. Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction. In Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 110-115. (Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022). doi: 10.1109/UBMK55850.2022.9919454

Measuring Bug Reporter's Reputation and Its Effect on Bug Resolution Time Prediction

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this