Bottleneck Analysis via Grammar-based Performance Fuzzing*

Yavuz Koroglu; Franz Wotawa

doi:10.1109/ICSTW58534.2023.00041

Bottleneck Analysis via Grammar-based Performance Fuzzing^*

Yavuz Koroglu
, Franz Wotawa

Graz University of Technology

Araştırma sonucu: Kitap/Rapor/Konferans Bildirisinde Bölüm › Konferans katkısı › bilirkişi

Özet

Performance is a general quality attribute of every software system that developers always want to improve. A performance fuzzer helps developers in this task by automatically generating inputs hitting performance bottlenecks. However, a developer must still manually localize the root causes of these bottlenecks. In this study, we perform grammar-based performance fuzzing on an example System Under Test (SUT), focusing on response time for determining problematic grammar constructs with the highest likelihood of causing bottlenecks. We show that replacing these constructs creates an average of 40.53x speedup on 24 bottleneck cases out of 50. Furthermore, avoiding the problematic constructs in the input generation provides an average of 1.46x speedup. These preliminary results suggest a measurable link between grammar constructs and performance bottlenecks, opening up the possibility of high-level categorization and analysis.

Orijinal dil	İngilizce
Ana bilgisayar yayını başlığı	Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023
Yayınlayan	Institute of Electrical and Electronics Engineers Inc.
Sayfalar	180-185
Sayfa sayısı	6
ISBN (Elektronik)	9798350333350
DOI'lar	https://doi.org/10.1109/ICSTW58534.2023.00041
Yayın durumu	Yayınlandı - 2023
Harici olarak yayınlandı	Evet
Etkinlik	16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023 - Dublin, Ireland Süre: 16 Nis 2023 → 20 Nis 2023

Yayın serisi

Adı	Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???	16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023
Ülke/Bölge	Ireland
Şehir	Dublin
Periyot	16/04/23 → 20/04/23

Bibliyografik not

Publisher Copyright:
© 2023 IEEE.

Belgeye Erişim

10.1109/ICSTW58534.2023.00041

Diğer Dosyalar ve Linkler

Link to publication in Scopus

Alıntı Yap

Koroglu, Y., & Wotawa, F. (2023). Bottleneck Analysis via Grammar-based Performance Fuzzing^*. In Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023 (pp. 180-185). (Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSTW58534.2023.00041

Koroglu, Yavuz ; Wotawa, Franz. / Bottleneck Analysis via Grammar-based Performance Fuzzing^*. Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 180-185 (Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023).

@inproceedings{af45b521d663410db87503ff1a119e70,

title = "Bottleneck Analysis via Grammar-based Performance Fuzzing*",

abstract = "Performance is a general quality attribute of every software system that developers always want to improve. A performance fuzzer helps developers in this task by automatically generating inputs hitting performance bottlenecks. However, a developer must still manually localize the root causes of these bottlenecks. In this study, we perform grammar-based performance fuzzing on an example System Under Test (SUT), focusing on response time for determining problematic grammar constructs with the highest likelihood of causing bottlenecks. We show that replacing these constructs creates an average of 40.53x speedup on 24 bottleneck cases out of 50. Furthermore, avoiding the problematic constructs in the input generation provides an average of 1.46x speedup. These preliminary results suggest a measurable link between grammar constructs and performance bottlenecks, opening up the possibility of high-level categorization and analysis.",

keywords = "bottleneck analysis, grammar-based fuzzing, performance testing",

author = "Yavuz Koroglu and Franz Wotawa",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023 ; Conference date: 16-04-2023 Through 20-04-2023",

year = "2023",

doi = "10.1109/ICSTW58534.2023.00041",

language = "English",

series = "Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "180--185",

booktitle = "Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023",

address = "United States",

}

Koroglu, Y & Wotawa, F 2023, Bottleneck Analysis via Grammar-based Performance Fuzzing^*. in Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023. Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023, Institute of Electrical and Electronics Engineers Inc., pp. 180-185, 16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023, Dublin, Ireland, 16/04/23. https://doi.org/10.1109/ICSTW58534.2023.00041

Bottleneck Analysis via Grammar-based Performance Fuzzing^*. / Koroglu, Yavuz; Wotawa, Franz.
Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 180-185 (Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023).

Araştırma sonucu: Kitap/Rapor/Konferans Bildirisinde Bölüm › Konferans katkısı › bilirkişi

TY - GEN

T1 - Bottleneck Analysis via Grammar-based Performance Fuzzing*

AU - Koroglu, Yavuz

AU - Wotawa, Franz

PY - 2023

Y1 - 2023

N2 - Performance is a general quality attribute of every software system that developers always want to improve. A performance fuzzer helps developers in this task by automatically generating inputs hitting performance bottlenecks. However, a developer must still manually localize the root causes of these bottlenecks. In this study, we perform grammar-based performance fuzzing on an example System Under Test (SUT), focusing on response time for determining problematic grammar constructs with the highest likelihood of causing bottlenecks. We show that replacing these constructs creates an average of 40.53x speedup on 24 bottleneck cases out of 50. Furthermore, avoiding the problematic constructs in the input generation provides an average of 1.46x speedup. These preliminary results suggest a measurable link between grammar constructs and performance bottlenecks, opening up the possibility of high-level categorization and analysis.

AB - Performance is a general quality attribute of every software system that developers always want to improve. A performance fuzzer helps developers in this task by automatically generating inputs hitting performance bottlenecks. However, a developer must still manually localize the root causes of these bottlenecks. In this study, we perform grammar-based performance fuzzing on an example System Under Test (SUT), focusing on response time for determining problematic grammar constructs with the highest likelihood of causing bottlenecks. We show that replacing these constructs creates an average of 40.53x speedup on 24 bottleneck cases out of 50. Furthermore, avoiding the problematic constructs in the input generation provides an average of 1.46x speedup. These preliminary results suggest a measurable link between grammar constructs and performance bottlenecks, opening up the possibility of high-level categorization and analysis.

KW - bottleneck analysis

KW - grammar-based fuzzing

KW - performance testing

UR - https://www.scopus.com/pages/publications/85163121750

U2 - 10.1109/ICSTW58534.2023.00041

DO - 10.1109/ICSTW58534.2023.00041

M3 - Conference contribution

AN - SCOPUS:85163121750

T3 - Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023

SP - 180

EP - 185

BT - Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023

Y2 - 16 April 2023 through 20 April 2023

ER -

Koroglu Y, Wotawa F. Bottleneck Analysis via Grammar-based Performance Fuzzing^*. In Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 180-185. (Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023). doi: 10.1109/ICSTW58534.2023.00041