On Entropy, Information, and Conservation of Information
The term <i>entropy</i> is used in different meanings in different contexts, sometimes in contradictory ways, resulting in misunderstandings and confusion. The root cause of the problem is the close resemblance of the defining mathematical expressions of <i>entropy</i> in sta...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-06-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/23/6/779 |
| _version_ | 1827689387165483008 |
|---|---|
| author | Yunus A. Çengel |
| author_facet | Yunus A. Çengel |
| author_sort | Yunus A. Çengel |
| collection | DOAJ |
| description | The term <i>entropy</i> is used in different meanings in different contexts, sometimes in contradictory ways, resulting in misunderstandings and confusion. The root cause of the problem is the close resemblance of the defining mathematical expressions of <i>entropy</i> in statistical thermodynamics and <i>information</i> in the communications field, also called <i>entropy</i>, differing only by a constant factor with the unit ‘J/K’ in thermodynamics and ‘bits’ in the information theory. The thermodynamic property entropy is closely associated with the physical quantities of thermal energy and temperature, while the entropy used in the communications field is a mathematical abstraction based on probabilities of messages. The terms <i>information</i> and <i>entropy</i> are often used interchangeably in several branches of sciences. This practice gives rise to the phrase <i>conservation of entropy</i> in the sense of <i>conservation of information</i>, which is in contradiction to the fundamental <i>increase of entropy principle</i> in thermodynamics as an expression of the second law. The aim of this paper is to clarify matters and eliminate confusion by putting things into their rightful places within their domains. The notion of <i>conservation of information</i> is also put into a proper perspective. |
| first_indexed | 2024-03-10T10:16:01Z |
| format | Article |
| id | doaj.art-dbb0c5d289ce4e5393c4ab6efada80e4 |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-03-10T10:16:01Z |
| publishDate | 2021-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-dbb0c5d289ce4e5393c4ab6efada80e42023-11-22T00:50:02ZengMDPI AGEntropy1099-43002021-06-0123677910.3390/e23060779On Entropy, Information, and Conservation of InformationYunus A. Çengel0Department of Mechanical Engineering, University of Nevada, Reno, NV 89557, USAThe term <i>entropy</i> is used in different meanings in different contexts, sometimes in contradictory ways, resulting in misunderstandings and confusion. The root cause of the problem is the close resemblance of the defining mathematical expressions of <i>entropy</i> in statistical thermodynamics and <i>information</i> in the communications field, also called <i>entropy</i>, differing only by a constant factor with the unit ‘J/K’ in thermodynamics and ‘bits’ in the information theory. The thermodynamic property entropy is closely associated with the physical quantities of thermal energy and temperature, while the entropy used in the communications field is a mathematical abstraction based on probabilities of messages. The terms <i>information</i> and <i>entropy</i> are often used interchangeably in several branches of sciences. This practice gives rise to the phrase <i>conservation of entropy</i> in the sense of <i>conservation of information</i>, which is in contradiction to the fundamental <i>increase of entropy principle</i> in thermodynamics as an expression of the second law. The aim of this paper is to clarify matters and eliminate confusion by putting things into their rightful places within their domains. The notion of <i>conservation of information</i> is also put into a proper perspective.https://www.mdpi.com/1099-4300/23/6/779entropyinformationconservation of informationcreation of informationdestruction of informationBoltzmann relation |
| spellingShingle | Yunus A. Çengel On Entropy, Information, and Conservation of Information Entropy entropy information conservation of information creation of information destruction of information Boltzmann relation |
| title | On Entropy, Information, and Conservation of Information |
| title_full | On Entropy, Information, and Conservation of Information |
| title_fullStr | On Entropy, Information, and Conservation of Information |
| title_full_unstemmed | On Entropy, Information, and Conservation of Information |
| title_short | On Entropy, Information, and Conservation of Information |
| title_sort | on entropy information and conservation of information |
| topic | entropy information conservation of information creation of information destruction of information Boltzmann relation |
| url | https://www.mdpi.com/1099-4300/23/6/779 |
| work_keys_str_mv | AT yunusacengel onentropyinformationandconservationofinformation |