Interactive Production Performance Feedback in the IDE
© 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performan...
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
IEEE
2021
|
Online Access: | https://hdl.handle.net/1721.1/137037 |
_version_ | 1826194920765915136 |
---|---|
author | Cito, Jurgen Leitner, Philipp Rinard, Martin C Gall, Harald C. |
author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Cito, Jurgen Leitner, Philipp Rinard, Martin C Gall, Harald C. |
author_sort | Cito, Jurgen |
collection | MIT |
description | © 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performance model suitable for integration into interactive development environments. PerformanceHat's ability to incrementally update this global model as the software is changed in the development environment enables it to deliver near real-time predictions of performance consequences reflecting the impact on the production environment. We implement PerformanceHat as an Eclipse plugin and evaluate it in a controlled experiment with 20 professional software developers implementing several software maintenance tasks using our approach and a representative baseline (Kibana). Our results indicate that developers using PerformanceHat were significantly faster in (1) detecting the performance problem, and (2) finding the root-cause of the problem. These results provide encouraging evidence that our approach helps developers detect, prevent, and debug production performance problems during development before the problem manifests in production. |
first_indexed | 2024-09-23T10:03:57Z |
format | Article |
id | mit-1721.1/137037 |
institution | Massachusetts Institute of Technology |
language | English |
last_indexed | 2024-09-23T10:03:57Z |
publishDate | 2021 |
publisher | IEEE |
record_format | dspace |
spelling | mit-1721.1/1370372022-09-26T15:29:47Z Interactive Production Performance Feedback in the IDE Cito, Jurgen Leitner, Philipp Rinard, Martin C Gall, Harald C. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science © 2019 IEEE. Because of differences between development and production environments, many software performance problems are detected only after software enters production. We present PerformanceHat, a new system that uses profiling information from production executions to develop a global performance model suitable for integration into interactive development environments. PerformanceHat's ability to incrementally update this global model as the software is changed in the development environment enables it to deliver near real-time predictions of performance consequences reflecting the impact on the production environment. We implement PerformanceHat as an Eclipse plugin and evaluate it in a controlled experiment with 20 professional software developers implementing several software maintenance tasks using our approach and a representative baseline (Kibana). Our results indicate that developers using PerformanceHat were significantly faster in (1) detecting the performance problem, and (2) finding the root-cause of the problem. These results provide encouraging evidence that our approach helps developers detect, prevent, and debug production performance problems during development before the problem manifests in production. 2021-11-01T18:36:54Z 2021-11-01T18:36:54Z 2019-08 2021-04-15T15:18:31Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137037 Cito, Jurgen, Leitner, Philipp, Rinard, Martin C and Gall, Harald C. 2019. "Interactive Production Performance Feedback in the IDE." Proceedings - International Conference on Software Engineering, 2019-May. en http://dx.doi.org/10.1109/ICSE.2019.00102 Proceedings - International Conference on Software Engineering Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf IEEE MIT web domain |
spellingShingle | Cito, Jurgen Leitner, Philipp Rinard, Martin C Gall, Harald C. Interactive Production Performance Feedback in the IDE |
title | Interactive Production Performance Feedback in the IDE |
title_full | Interactive Production Performance Feedback in the IDE |
title_fullStr | Interactive Production Performance Feedback in the IDE |
title_full_unstemmed | Interactive Production Performance Feedback in the IDE |
title_short | Interactive Production Performance Feedback in the IDE |
title_sort | interactive production performance feedback in the ide |
url | https://hdl.handle.net/1721.1/137037 |
work_keys_str_mv | AT citojurgen interactiveproductionperformancefeedbackintheide AT leitnerphilipp interactiveproductionperformancefeedbackintheide AT rinardmartinc interactiveproductionperformancefeedbackintheide AT gallharaldc interactiveproductionperformancefeedbackintheide |