Stochastic resonance

Signal boosting phenomenon using white noise From Wikipedia, the free encyclopedia

Stochastic resonance (SR) is a mathematical mechanism and behavior of nonlinear systems[1] (that is, systems in which the change of the output is not proportional to the change of the input) where random (stochastic) fluctuations in the microstate of a system (that is, its specific configuration, including the precise positions and momenta of all its individual particles or components) cause deterministic (that is, non-random) changes in a macrostate (that is, a subset of the system's microstates[2][3][4]).

This occurs when the nonlinear nature of the system amplifies certain (resonant) portions of the fluctuations, while not amplifying other portions of the noise. The nonlinear system, immersed in a certain level of stochastic background noise, becomes sensitive to external perturbations that would be too weak to influence it in the absence of such noise.[5]

Originally proposed in the context of climate dynamics,[6][7][8] over time it has become important in numerous fields that study a wide variety of systems,[9] particularly in information theory[10] and in neuroscience.[1] Phenomena attributable to stochastic resonance have also been observed in other types of physical systems, such as chemical reactions,[11] quantum systems,[12] and industrial processes.[13] Stochastic resonance is also closely related to the concept of dithering in signal analysis,[14] although how similar or how different the two concepts are depends on the particular definition considered.[1]

Stochastic resonance was discovered and proposed for the first time in 1981 to explain the periodic recurrence of ice ages.[6] Nowadays stochastic resonance is commonly invoked when noise and nonlinearity concur to determine an increase of order in a system's response.

See the Review of Modern Physics article "Stochastic resonance"[15] for a comprehensive overview of stochastic resonance.

History

The mechanism of stochastic resonance was first described in the early 1980s by the Italian physicists Roberto Benzi, Alfonso Sutera, and Angelo Vulpiani,[16] who (with the additional participation of Giorgio Parisi) immediately applied it to climatology,[6][8] in order to explain how small variations in the motion of the Earth (the so-called Milankovitch cycles) can cause large variations in the Earth's climate (in particular, the transition from glacial periods to interglacial periods, and vice versa). According to Parisi's account, the name "stochastic resonance" was coined by Benzi during a conference.[17] At the same time, a very similar explanation was also proposed by the Belgian physicist Catherine Nicolis.[7]

An initial experimental verification was found as early as 1983 in a bistable electronic circuit,[18] and in 1988 in a laser system.[19] In the early 1990s, the first works appeared in which it was hypothesized that stochastic resonance played an important role in neuronal dynamics,[20][21] a concept now confirmed.[1][22]

Climatological interpretation

In the original works of Benzi, Parisi, Sutera, and Vulpiani, the potential depending on the Earth's mean temperature (i.e., the variable corresponding to ) was linked to the albedo of the Earth, that is, the fraction of incoming solar radiation that is reflected back into space rather than absorbed by the planet. It depends on numerous factors closely related to the Earth's climate, the main ones being the extent of the ice sheets and cloud cover. In general it was assumed that the albedo tends to a maximum both for extremely low temperatures (since the planet would be completely covered by highly reflective ice) and for high temperatures (since high temperature is associated with high evaporation, and therefore with extensive cloud cover, which is also reflective), while the two stable states of minimum albedo were associated with glacial periods and interglacial periods.[6][23]

Information theory

In information theory, SR can be used to reveal weak signals. When a signal that is normally too weak to be detected by a sensor can be boosted by adding white noise to the signal, which contains a wide spectrum of frequencies. The frequencies in the white noise corresponding to the original signal's frequencies will resonate with each other, amplifying the original signal while not amplifying the rest of the white noise – thereby increasing the signal-to-noise ratio, which makes the original signal more prominent. Further, the added white noise can be enough to be detectable by the sensor, which can then filter it out to effectively detect the original, previously undetectable signal.

This phenomenon of boosting undetectable signals by resonating with added white noise extends to many other systems – whether electromagnetic, physical or biological – and is an active area of research.[24]

Technical description

Stochastic resonance (SR) is observed when noise added to a system changes the system's behaviour in some fashion. More technically, SR occurs if the signal-to-noise ratio of a nonlinear system or device increases for moderate values of noise intensity. It often occurs in bistable systems or in systems with a sensory threshold and when the input signal to the system is "sub-threshold." For lower noise intensities, the signal does not cause the device to cross threshold, so little signal is passed through it. For large noise intensities, the output is dominated by the noise, also leading to a low signal-to-noise ratio. For moderate intensities, the noise allows the signal to reach threshold, but the noise intensity is not so large as to swamp it. Thus, a plot of signal-to-noise ratio as a function of noise intensity contains a peak.

Strictly speaking, stochastic resonance occurs in bistable systems, when a small periodic (sinusoidal) force is applied together with a large wide band stochastic force (noise). The system response is driven by the combination of the two forces that compete/cooperate to make the system switch between the two stable states. The degree of order is related to the amount of periodic function that it shows in the system response. When the periodic force is chosen small enough in order to not make the system response switch, the presence of a non-negligible noise is required for it to happen. When the noise is small, very few switches occur, mainly at random with no significant periodicity in the system response. When the noise is very strong, a large number of switches occur for each period of the sinusoid, and the system response does not show remarkable periodicity. Between these two conditions, there exists an optimal value of the noise that cooperatively concurs with the periodic forcing in order to make almost exactly one switch per period (a maximum in the signal-to-noise ratio).

Such a favorable condition is quantitatively determined by the matching of two timescales: the period of the sinusoid (the deterministic time scale) and the Kramers rate[25] (i.e., the average switch rate induced by the sole noise: the inverse of the stochastic time scale[26][27]).

Simplified model

Generic shape of the potential

Below is a didactic toy model capable of capturing the essential aspects of the stochastic resonance mechanism.[5][16][15]

Starting equation

Consider a time-dependent physical variable (which, in the original climate papers, was the mean temperature of the Earth), described by a stochastic differential equation of the Langevin equation type:

where is a potential function determining the system dynamics, is a stochastic forcing corresponding to background noise, and is the external periodic perturbation, of small amplitude (), which in the climate studies corresponded to the Milankovitch cycles. It is assumed that has a double-well shape (describable by a fourth-degree polynomial), i.e., it possesses two stable minima and (glacial and interglacial periods) separated by an unstable maximum , corresponding to a potential barrier (for simplicity it is assumed that the two minima lie at the same level ). For the simplest possible form is considered, namely that of Gaussian noise, with zero mean and Dirac delta correlation: and .

In the absence of periodic perturbations (), it is well known from the theory of Markov processes that the variable will fluctuate around the minimum points, with a variance proportional to the Gaussian noise intensity . Occasionally the fluctuations will be strong enough to allow crossing of the potential barrier, and therefore the transition from one minimum state to the other. In the limit , the mean transition frequency is given by the so-called Kramers formula:

where is the second derivative of .

Stochastic resonance

In the presence of periodic perturbations, the potential is replaced by the generalized potential . This means that the two potential wells vary in height, rising and falling, and therefore the barrier that the system must overcome to jump from one minimum to the other will at some moments be higher and at others lower. However, the oscillations are of small amplitude, so they are not able to completely remove the barrier and thus allow the system to transition between states on their own: the idea of stochastic resonance is that, if the perturbation frequency is in some way comparable with the mean transition frequency , then the random fluctuations of the system will tend to synchronize with the external oscillations, making the transition more likely.

Using the explicit form of the potential , it can be shown that, at least to first order approximation, the mean value of becomes a periodic function of time with the same frequency as the external forcing:

where the amplitude and the phase are given by the following relations:

Typical behavior of the amplitude as a function of the noise intensity .

with the variance of in the absence of external perturbations (dependent on the noise intensity ).

The fundamental aspects are therefore:

  • the system oscillations tend, on average, to synchronize with the external perturbations;
  • the amplification effect is negligible unless the perturbation frequency is comparable with the transition frequency (dependent on the noise intensity), and it is maximal for ;
  • for fixed perturbation amplitude and frequency , the amplitude is, for low noise intensities, a sharply increasing function of , reaching a maximum peak at an intermediate noise level, and then becoming a decreasing function of for large noise values.

Suprathreshold

Suprathreshold stochastic resonance is a particular form of stochastic resonance, in which random fluctuations, or noise, provide a signal processing benefit in a nonlinear system. Unlike most of the nonlinear systems in which stochastic resonance occurs, suprathreshold stochastic resonance occurs when the strength of the fluctuations is small relative to that of an input signal, or even small for random noise. It is not restricted to a subthreshold signal, hence the qualifier.

Neuroscience, psychology and biology

Stochastic resonance has been observed in the neural tissue of the sensory systems of several organisms.[28] Computationally, neurons exhibit SR because of non-linearities in their processing. SR has yet to be fully explained in biological systems, but neural synchrony in the brain (specifically in the gamma wave frequency[29]) has been suggested as a possible neural mechanism for SR by researchers who have investigated the perception of "subconscious" visual sensation.[30] Single neurons in vitro including cerebellar Purkinje cells[31] and squid giant axon[32] could also demonstrate the inverse stochastic resonance, when spiking is inhibited by synaptic noise of a particular variance.

Medicine

SR-based techniques have been used to create a novel class of medical devices for enhancing sensory and motor functions such as vibrating insoles especially for the elderly, or patients with diabetic neuropathy or stroke.[33]

Stochastic resonance has found noteworthy application in the field of image processing.

Signal analysis

A related phenomenon is dithering, applied to analog signals before analog-to-digital conversion.[14] Stochastic resonance can be used to measure transmittance amplitudes below an instrument's detection limit. If Gaussian noise is added to a subthreshold (i.e., immeasurable) signal, then it can be brought into a detectable region. After detection, the noise is removed. A fourfold improvement in the detection limit can be obtained.[34]

See also

References

Bibliography

Related Articles

Wikiwand AI