FLUCTUATION AND NOISE EXPLOITATION LABORATORY

Dept. of  Electrical  and  Computer  Engineering, Texas A&M University

home personnel research news conferences journals funding collaboration

 


Myth-busting in Physics and Information Technology




Picture of MythBusters on
                              Discovery Channel

What we show in this page
below is similar in nature to the Discovery Channel's MythBusters (see on the left) who bust or verify everyday myths, except that we do this within the professional fields of science and technology. As a consequence, while our story can sometimes be as funny as their show; the stakes and the matters are much more serious with potential impacts on the direction of science/technology and its funding. The sad part of the story is that there is a flood of new myths in science, in the popular science media and even in some of the leading scientific journals. The myths usually come with a great hype that can potentially discredit reasonable scientific claims, if the present trend continues.
 


Below,
a few of the important myths that we had busted are shown, in (roughly) inverse-chronological-order. We focus on myths where stochastics has a role (explicit or implicit).


1. Information entropy and thermodynamic entropy: apples and oranges

Myth: It had generally been assumed that there is a general interrelation between the information entropy and the thermodynamical entropy in physical systems.

Status of myth: Busted.

Reason: The change of information entropy during measurement is determined by the resolution of the measurement instrument and these changes do not have a general and clear-cut interrelation with the change of thermal entropy. Moreover, these changes can be separated in space and time.

More details: We have shown that the two major efforts to find general physical principles that interrelate changes in the information entropy and the thermal entropy in physical systems are invalid.

Particularly:

i) In general, the information entropy and its changes contain a component that is subjective to the measurement instrument, while the changes of thermal entropy can be stated objectively.

ii) Brillouin's negentropy principle of information (the expanded formulation of the Second Law), is invalid as a general rule because violations can also occur in a physical system provided the temperature of the measurement system is lower than that of the measured physical system.

iii) In the case of homogeneous temperatures, it can be seemingly valid if the measurement system is integrated with the measured physical system, or if not, it can be valid within the measurement system alone. However, in classical physical situations, the measurement system and the measured physical system, as well as the change of information entropy and the related change of thermal entropy can be separated in space and time leading to the break of Brillouin's negentropy principle.

iv) The information entropy can increase without triggering any change of the thermal entropy indicating that information erasure does not necessarily require energy dissipation.

v) There is no case where Landauer's principle of erasure dissipation is even seemingly valid because erasing of the known memory content by resetting does not yield change in the information entropy.

vi) The information entropy can violate the Third Law of Thermodynamics.

Paper: L.B. Kish, D. Ferry, "Information entropy and thermal entropy: apples and oranges", accepted for publication in Journal of Computational Electronics (2017). download
See also https://arxiv.org/abs/1706.01459 .



2. Memristors are not the "missing" circuit elements because they are not necessarily passive

Myth: It has been claimed that the memristor is the "missing" (passive) circuit element.

Status of myth: Busted.

Reason: In their present noise-free form, Chua's memristor equations require the presence of an active device in infinitely many cases of memristor functions.

Chua's general proof that the memristor is passive based on his memristor equations is invalid because the memristor equations do not provide a sufficient description of the physics of memristors. A relevant statistical thermodynamics is needed for the memristors however the memristor equations do not contain sufficient physics to deduce that.

While the response functions of passive resistors, capacitors and inductors determine their Fluctuation-Dissipation Theorem (FDT), the memristor model lacks sufficient physics for a FDT. To create the noise theory (FDT) of a memristor, it is essential to know the internal material structure of the particular memristor thus its generic formulation, like it is done with the three basic circuit elements, is impossible.

Papers:

- K. Sundqvist, D.K. Ferry, L.B. Kish, "Memristor equations: incomplete physics and undefined passivity/activity", Fluctuation and Noise Lett. 16 (2017) 1771001. download
See also: https://arxiv.org/abs/1703.09064

- K.M. Sundqvist, D.K. Ferry, L.B. Kish, "Second Law based definition of passivity/activity of devices", Physics Letters A 381 (2017) 3364–3368.
download
See also: https://arxiv.org/abs/1705.08750


3. Non-zero thermal noise at zero temperature due to the quantum Fluctuation-Dissipation-Theorem

Myth:There is a longstanding debate about the zero-point term in the Johnson noise voltage of a resistor. This term originates from a quantum-theoretical treatment of the Fluctuation-Dissipation Theorem (FDT). The classical Johnson–Nyquist formula vanishes at the approach of zero temperature, but the quantum zero-point term still predicts non-zero noise voltage and current. The myth is that such a zeropoint noise is objectively present in the system independently from the type of measurement equipment.

Status of myth: Busted.

Reason: New features emerge when the consequences of the zero-point term are measured via the mean energy and force in a capacitor shunting the resistor. If these measurements verify the existence of a zero-point term in the noise, then two types of perpetual motion machines can be constructed. Further investigation with the same approach shows that, in the quantum limit, the Johnson–Nyquist formula is also invalid under general conditions even though it is valid for a resistor-antenna system. Therefore we conclude that a satisfactory quantum theory of the Johnson noise, the Fluctuation-Dissipation Theorem, must, as a minimum, include also the measurement system used to evaluate the observed quantities.
Moreover, we showed that thezero-point noise cannot be reconciled with the Fermi–Dirac distribution, which defines the thermodynamics of electrons according to quantum-statistical physics. Consequently, Johnson noise must be nil at zero temperature, and non-zero noise found for certain experimental arrangements may be an measurement artifact, such as the one mentioned in Kleen’s uncertainty relation argument.

Papers:

- L.B. Kish, G.A. Niklasson, C.G Granqvist, "Zero-point term and quantum effects in the Johnson noise of resistors: A critical appraisal", J. Statistical Mechanics 2016 (2016) 054006. doi:10.1088/1742-5468/2016/05/054006 . See also: http://arxiv.org/abs/1504.08229 .

- L.B. Kish, G.A. Niklasson, C.G. Granqvist, "Zero thermal noise in resistors at zero temperature", Fluctuation and Noise Lett. 15 (2016) 1640001.
  online:  http://www.researchgate.net/publication/303959024_Zero_Thermal_Noise_in_Resistors_at_Zero_Temperature



4. Unconditionally secure communications (key exchange) provided by the laws of physics  (2005-present)

Myth: It had generally been assumed that only quantum physics was able to provide unconditional security of the key exchange. Securing a classical wire without a previously exchanged secret key seemed to be impossible because the current and voltage are measurable without disturbing the system (at least in the ideal situation).

Status of myth: Busted.

Reason: It has been shown that classical thermodynamics (statistical physics) and Kirchhoff's loop law can also provide an unconditionally secure key exchange. In the ideal situation of the Kirchhoff-law-Johnson-noise (KLJN) scheme, the Second Law of Thermodynamics guarantees perfect ecurity. Consequently, it is as impossible to crack the KLJN scheme as to build a perpetual motion machine (of the second kind). In the non-ideal case, similarly to ideal quantum key exchange, there is an information leak about the key toward the eavesdropper. However, this information leak can be suppressed below any required level, which means unconditional security. The price is invested resources such as cost of wires and/or time invested into the exchange of secure key bits. Out of the Second Law, the security of the non-ideal case utilizes the finite information of a band-limited stochastic signal of finite duration (time-error uncertainty principle of statistics).

General security proof of KLJN utilizing the continuity of functions in stable classical physical systems: L.B. Kish, C.G. Granqvist, "On the security of the Kirchhoff-law-Johnson-noise (KLJN) communicator", Quantum Information Processing 13 (2014) 2213-2219. http://arxiv.org/abs/1309.4112

Most extensive/deep recent review:  L.B. Kish, D. Abbott, C.G. Granqvist, "Critical Analysis of the Bennett–Riedel Attack on Secure Cryptographic Key Distributions via the Kirchhoff-Law–Johnson-Noise Scheme", PLOS ONE  8 (2013) e81810.

Brief introductory text, less advanced aspects: D. Abbott, G. Schmera, "Secure communications using the KLJN scheme", Scholarpedia 8 (2013) 31157.

Book: L.B. Kish, "The Kish Cypher. The story of KLJN for unconditional security". (2017), World Scientific. ISBN: 978-981-4449-45-8 (hardcover);  and ISBN: 978-981-4449-47-2 (ebook).
     https://sites.google.com/site/kishcypher/


5. Energy dissipation of control; Maxwell demon and Szilard engine (2011-present)

Myth-1: It had generally been assumed that, in the Szilard engine, controlling the motion/position of the piston during restoring the initial state requires negligible amount of energy dissipation compared to the work the Szilard engine can produce.

Status of myth-1: Busted.

Reasons: It has been shown that, in the limit of 50% error probability (that is at 0% efficiency), the minimum energy dissipated at any single-bit operation is greater than kT ln(2), which is equal to the net work the Szilard engine can produce when the efficiency 100%. Thus even a single bit operation with reasonable (non-zero) error probability would dissipate more energy than work the engine can produce at any efficiency. It is shown that the control operation of restoring the piston's position at the end of the cycle requires at lest 5 single-bit operations, that is, at least 5 kT ln(2) energy dissipation even at zero efficiency of these operations. This is 5 times more than the work the Szilard engine can produce at 100% efficiency, therefore this effect alone can save the Second Law of Thermodynamics. See much more in:

L.B. Kish, C.G. Granqvist, "Energy Requirement of Control: Comments on the Maxwell Demon and the Szilard Engine"
EPL 98
(2012) 68001. (Note: a former version utilizing equivalence theory was published in the conference proceedings book "All the colors of noise. Essays in Honor of Lino Reggiani" in 2010).

=============

Myth-2: It has often been assumed that, in a Maxwell demon and Szilard engine, the energy dissipation in the memory is the component that is unavoidable and dominant at ideal conditions.

Status of myth-2: Busted.

Reason: By introducing an improved Maxwell demon and Szilard engine
that are utilizing Johnson noise, measurement, logic and control to quantitatively analyze the energy requirement of  all  components during the  full  cycle of operation, it is proven that the analog part of the demon/engine, which is essential in the physical realization of any measurement/decision process, dissipates exponentially more energy than the binary part of the system (including the memory), when the energy output of these engines is increased. See much more in:

L.B. Kish, C.G. Granqvist, "
Electrical Maxwell Demon and Szilard Engine Utilizing Johnson Noise, Measurement, Logic and Control",
PLoS ONE  7 (2012) e46800.


6. Twisted radio waves to enhance wireless capacity (2012-2013)

Myth: Orbital wave modes (twisted wave modes) offer independent information channels on top of the two, classically used, polarization modes. If this myth were true, twisted wave modes could offer virtually infinite information channel capacity in a classical single wireless frequency band.  See this BBC news item and the linked paper.

Status of myth: Busted.

Reason: The assumption that the orbital wave modes in the far-field of radio waves represent information channels that are
independent from both basic polarization waves violates the Second Law of Thermodynamics, that is, allows the construction of a perpetual motion machine (of the second kind). If it were true, using a resistor and a twisted-wave-antenna, one could pump thermal energy into an absorbing wall at the same temperature as the resistor; while the plane-wave radiation from the wall would not be able to re-feed this energy into the resistor. Such a violation of the detailed balance of energy allows the construction of a perpetual motion machine (of the second kind). In conclusion, any twisted-wave antenna must be sensitive to at least one of the polarization components of plane waves otherwise the Second Law of Thermodynamics is violated. That means, twisted waves do not represent new, independent information channels.

See: L.B. Kish, R.D. Nevels, "Twisted Radio Waves and Twisted Thermodynamics",
PLoS ONE 8(2): e56086 (open access).

- BBC news item mentioning this at the end.




7. Physical systems for high-efficiency computation with small hardware and time complexity (2009-present)

Myth-1: It has been generally supposed that noise in a logic system is the source of errors (even though neural signals in the brain are noise) and to avoid these problems a large energy dissipation is required in a computer.

Status of myth-1: Busted. Noise-based logic utilizes the noise in the system as information carrier.

Myth-2: It has been generally supposed that only quantum systems can represent and manipulate 2^N bits by O(N) (or polynomial) hardware and time complexity.

Status of myth-2:
Busted. Noise-based logic offers the same exponential performance enhancement potential by utilizing classical statistical physics.
 
Myth-3: It has been generally supposed that the logic signal in the brain is statistical: it is either the mean frequency of neural pulses or the statistical correlations between these frequencies at different points of the brain. 

Status of myth-3: Busted. Noise-based brain-logic utilizes coincidence events of single neural spikes instead of statistics and achieves exponential speedup.

  See more at the Noise-based logic page.




More (older) myth-busting stories:



Debate on the security of quantum key distribution (QKD);
Debate on the validity of Landauer's principle and reversible computing;
Debate on the feasibility of quantum computing.


8. Energy dissipation in general-purpose classical and quantum computers (2004-05)

9. Moore's laws of miniaturization (2003-05)

9. Lognormal size distribution of nanoparticles by advanced gas evaporation (1998)

10. Stochastic resonance (1994-96; 2001)

11. High-temperature superconductors (1990-94)

12. Self-organized criticality (1990)

13.
Universal conductance fluctuations (1990)

14. Quantum 1/f noise model (1986-87)
         

 
 








 

 

 

 

 

FNEL HOME TAMU HOME TAMU E.E. DEPT. TAMU IEEE TAMU LIBRARY

Departmentof Electrical Engineering, Texas A&M University
Zachry Building, Room # 30D, Phone: (979)-845-1729