Interactive Production Performance Feedback in the IDE

© 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performan...

Full description

Bibliographic Details
Main Authors: Cito, Jurgen, Leitner, Philipp, Rinard, Martin C, Gall, Harald C.
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:English
Published: IEEE 2021
Online Access:https://hdl.handle.net/1721.1/137037
_version_ 1826194920765915136
author Cito, Jurgen
Leitner, Philipp
Rinard, Martin C
Gall, Harald C.
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Cito, Jurgen
Leitner, Philipp
Rinard, Martin C
Gall, Harald C.
author_sort Cito, Jurgen
collection MIT
description © 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performance model suitable for integration into interactive development environments. PerformanceHat's ability to incrementally update this global model as the software is changed in the development environment enables it to deliver near real-time predictions of performance consequences reflecting the impact on the production environment. We implement PerformanceHat as an Eclipse plugin and evaluate it in a controlled experiment with 20 professional software developers implementing several software maintenance tasks using our approach and a representative baseline (Kibana). Our results indicate that developers using PerformanceHat were significantly faster in (1) detecting the performance problem, and (2) finding the root-cause of the problem. These results provide encouraging evidence that our approach helps developers detect, prevent, and debug production performance problems during development before the problem manifests in production.
first_indexed 2024-09-23T10:03:57Z
format Article
id mit-1721.1/137037
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T10:03:57Z
publishDate 2021
publisher IEEE
record_format dspace
spelling mit-1721.1/1370372022-09-26T15:29:47Z Interactive Production Performance Feedback in the IDE Cito, Jurgen Leitner, Philipp Rinard, Martin C Gall, Harald C. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science © 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performance model suitable for integration into interactive development environments. PerformanceHat's ability to incrementally update this global model as the software is changed in the development environment enables it to deliver near real-time predictions of performance consequences reflecting the impact on the production environment. We implement PerformanceHat as an Eclipse plugin and evaluate it in a controlled experiment with 20 professional software developers implementing several software maintenance tasks using our approach and a representative baseline (Kibana). Our results indicate that developers using PerformanceHat were significantly faster in (1) detecting the performance problem, and (2) finding the root-cause of the problem. These results provide encouraging evidence that our approach helps developers detect, prevent, and debug production performance problems during development before the problem manifests in production. 2021-11-01T18:36:54Z 2021-11-01T18:36:54Z 2019-08 2021-04-15T15:18:31Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137037 Cito, Jurgen, Leitner, Philipp, Rinard, Martin C and Gall, Harald C. 2019. "Interactive Production Performance Feedback in the IDE." Proceedings - International Conference on Software Engineering, 2019-May. en http://dx.doi.org/10.1109/ICSE.2019.00102 Proceedings - International Conference on Software Engineering Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf IEEE MIT web domain
spellingShingle Cito, Jurgen
Leitner, Philipp
Rinard, Martin C
Gall, Harald C.
Interactive Production Performance Feedback in the IDE
title Interactive Production Performance Feedback in the IDE
title_full Interactive Production Performance Feedback in the IDE
title_fullStr Interactive Production Performance Feedback in the IDE
title_full_unstemmed Interactive Production Performance Feedback in the IDE
title_short Interactive Production Performance Feedback in the IDE
title_sort interactive production performance feedback in the ide
url https://hdl.handle.net/1721.1/137037
work_keys_str_mv AT citojurgen interactiveproductionperformancefeedbackintheide
AT leitnerphilipp interactiveproductionperformancefeedbackintheide
AT rinardmartinc interactiveproductionperformancefeedbackintheide
AT gallharaldc interactiveproductionperformancefeedbackintheide