# Prediction of human's ability in sound localization based on the statistical properties of spike trains along the brainstem auditory pathway.

1. IntroductionAdrian's classic research on neural activity [1] presented three essential observations which are as relevant today as they were when he first introduced them: (1) as individual neurons produce action potential which propagate through the brain, the information of the neural activity is encoded by spiking events; (2) the rate of the spikes is dependent upon the external stimuli that drives the neural cell; and (3) there is an adaptation mechanism that adjusts the cell response; that is, the neural activity is reduced for constant stimuli. Any model that purports to characterize a neural activity must take into account these basic principles.

In this study we refer to auditory systems in which irregular neuronal activity was demonstrated during in vivo recordings [2]. In vivo observations have also shown that a specific neuron might respond with a single spike or several spikes to a given stimuli as shown in [2]. Kiang's [2] observation is not in agreement with that of Adrian [1], who suggested that the stimuli information is coded by the average rate of the neural response. This contradiction raises the possibility that the timing of the spikes relative to the stimulus should be considered as well.

The origin of the stochastic activity of neurons is poorly understood. This activity results in both intrinsic noise sources that generate stochastic behavior on the level of the neuronal dynamics and extrinsic sources that arise from network effects and synaptic transmission [3]. Another source of noise that is specific to neurons arises from the finite number of ion channels in a neuronal membrane patch [4, 5].

There are a number of different ways that have emerged to describe the stochastic properties of neural activity. One possible approach relates to the train of spikes as a stochastic point process. For example, in their earlier studies, Alaoglu and Smith [6] and Rodieck et al. [7] suggested that the spontaneous activity of the cochlear nucleus can be described as a homogeneous Poisson process. Further investigations of the auditory system described the neural response as a nonhomogeneous Poisson point process (NHPP) whose instantaneous rate depends on the input stimuli [8, 9].

A meaningful characterization of neural activity can be derived by using stochastic properties in order to predict human performance. Up to the 19th century, when medical science was still in its infancy and the concept of neural activity was unknown, the only method of understanding and researching the brain was through a black-box approach based on psychoacoustical experiments. While these psychoacoustical experiments provided valuable information, they were regarded as limited since they only produced qualitative information. It was argued that the activities and the contents of the mind could not be measured and therefore could not be objective. This view began to change in the early 1800s when Ernst Weber (1795-1878) demonstrated two measures for quantifying psychological data that he obtained from testing subjects psychoacoustically: (1) the two-point threshold, in which the smallest distance noticeable to touch at various parts of the body is measured, and (2) the just-noticeable difference (JND), in which the smallest difference in weight a person is capable of distinguishing is measured.

In the mid-20th century, several classes of standard adaptive tests for psychoacoustic measurements were introduced for evaluating auditory resolution [10-12]. These measurements are used for comparing the relationship between prediction of neural models and psychoacoustical performances. In such psychoacoustical tests, subjects are asked to distinguish between close values of one of the signal's parameters, such as the signal's frequency or level in monaural stimulation, and the interaural level difference (ILD), or the interaural time difference (ITD) in binaural stimulation. The results of such experiments are the JND of the investigated parameter. Such experiments have been repeatedly performed and reported in the literature (e.g., [13-20]).

Comparing the behavioural JND and the neural activity is possible if one assumes that the neural system estimates the measured parameters. Siebert [21, 22] obtained such a comparison when the JND of a single tone's frequency and level was compared to the neural activity of the auditory nerve. Siebert's findings were based on the assumption that the auditory nerve (AN) response behaves as a NHPP, and the brain acts as an unbiased optimal estimator of the physical parameters. Thus, the JND is equal to the standard deviation of the estimated parameter and can be derived by lower bounds such as the Cramer-Rao lower bound. Heinz et al. [23, 24] generalized Siebert's results to a larger range of frequencies and levels. Colburn and his colleagues [25-29] obtained similar evaluations for binaural signals, where the JND of ITD and ILD was compared to the neural activity of the auditory nerves of both ears.

This approach was extended to analyze brainstem nuclei such as the superior olivary complex (SOC) and the inferior colliculus (IC). These nuclei receive inputs from both ears, integrate the information, and send it by means of neural spike trains to the upper nuclei in the auditory pathway [30-36].

The neural cells in the SOC and IC are frequently described as coincidence detector (CD) cells. These cells receive independent excitatory and inhibitory inputs and generate a spike if the number of excitatory inputs exceeds the number of inhibitory inputs by a known number during a short interval. Krips and Furst [37] showed that the CD cells behave as NHPP if their inputs are NHPP. Therefore, the JND of the binaural parameters such as ITD and ILD, which are presumably estimated at the level of the SOC or IC, can be derived on the basis of the CD cell outputs [38].

Two main types of CD cells are identified in the brainstem auditory pathway: excitatory-excitatory (EE) cells and excitatory-inhibitory (EI) cells. EE cells receive excitatory inputs from both (right and left) anteroventral cochlear nuclei (AVCN) and they fire when both inputs are received within a time interval of less than 50 [micro]sec [36, 39-41]. These types of cells are sensitive mainly to ITD. EI cells, on the other hand, are sensitive to the balance of intensity at the ears because the excitation, due to ipsilateral stimuli, is reduced by increasing levels of contralateral stimuli [40, 42-45].

The human ability to localize sound depends on ITD, ILD, and spectral information of the acoustic stimulus. The goal of this paper is to test whether the prediction of human performance in this task is possible from the AN response or whether the processing of higher auditory brainstem nuclei is required. We compare the prediction of human performance based on the stochastic properties of the spike trains at the level of the auditory nerve and at the level of the SOC.

2. Minimum Audible Angle

The minimum audible angle (MAA) test is a common means of evaluating human localization ability. In this test, two successive signals from different directions are aimed at a listener. The order of the two signals is random. The listener is instructed to indicate the direction of the two signals relative to each other. For example, in the horizontal plane, the subject is asked if the signal moved from right to left, or vice versa.

MAA experiments have been conducted with various experimental setups and testing procedures for different stimuli conditions [11, 46-50]. For a single-tone MAA in the horizontal plane, Mills' measurements [11] have become the generally accepted standard. MAA as a function of frequency at an azimuth of 0[degrees] is redrawn from Mills' [11] measurements in Figure 1. The MAA exhibits the following properties: (1) an increase of MAA as a function of frequency above 1 kHz and (2) an oscillatory behavior as a function of frequency with local maxima at about 1.5 and 8 kHz.

In a typical MAA experiment, the audio signal S(t,[theta]) enters both ears from a direction d relative to the nose. The incoming sounds to each ear are transformed as a function of the shape and size of the head, torso, and the pinna of the outer ears. These anatomical features are known as the head-related-transfer-function (HRTF) that can be measured and synthesized in the form of linear time-invariant filters.

In Figure 2, typical right and left HRTFs for an elevation of 0[degrees] are presented. They were obtained from Knowles Electronic Manikin for Acoustics Research (KEMAR) [51]. Both gain (Figure 2(a)) and phase (Figure 2(b)) are demonstrated in Figure 2 by color-coded scales. They are plotted as a function of both frequency (f) and direction ([theta]). The maximum gain for the right HRTF is obtained at high frequencies when the speaker is located in front of the right ear, that is, a direction of 90[degrees]. Similarly, maximum gain for the left HRTF is obtained when the speaker is located in front of the left ear, which corresponds to a direction of 270[degrees]. At frequencies above 1 kHz, the phase becomes ambiguous since different directions yield similar phases.

Formally, the signals that are conveyed to the left and right cochleae are

[S.sub.L](t, [theta]) = S(t, [theta]) x [HRIR.sub.L] (t, [theta]), [S.sub.R] (t, [theta]) = S (t, [theta]) x [HRIR.sub.R] (t, [theta]), (1)

where x represents a convolution and [HRIR.sub.L] (t, [theta]) and [HRIR.sub.R](t, [theta]) are the left and right head-related impulse responses, respectively.

In this study, we refer only to signals that are composed of simple tones, that is, S(t) = A sin(2[pi]ft), where A is the signal amplitude and f represents its frequency. The effects of the HRTF on such a signal are phase shifts and amplitude alterations that yield

[S.sub.L] (t, [theta]) = [A.sub.L]([theta]) sin (2[pi]ft + [[phi].sub.L] ([theta])), [S.sub.R] (t, [theta]) = [A.sub.R]([theta]) sin (2[pi]ft + [[pi].sub.R] ([theta])). (2)

Therefore, the resulting interaural differences are a phase difference (IPD) that is obtained by

IPD([theta]) = [[phi].sub.R]([theta]) - [[phi].sub.L]([theta]), (3)

which corresponds to ITD by

ITD([theta]) = IPD([theta])/2[pi]f, (4)

and interaural level difference (ILD) in dB is given by

ILD([theta]) = 20[log.sub.10]([A.sub.R]([theta]/[A.sub.L]([theta]) = 20 [log.sub.10]([theta]), (5)

where [delta] = [A.sub.R]([theta])/[A.sub.L]([theta]).

3. Estimating MAA on the Basis of the Stochastic Properties of Neural Spike Trains

We assume that during an MAA experiment, the brain's task is to estimate [theta]. The resultant unbiased estimator is [??], which yields

E[[??]|[[theta].sup.*]] = [[theta].sup.*], (6)

where [[theta].sup.*] is the true direction of the incoming signal. Generally, in a psychoacoustical JND experiment, the yielded JND value is obtained when d' = 1, where in an MAA experiment

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]

Therefore, d' = 1, yields the relations:

[DELTA][theta] = MAA = std ([??]|[[theta].sup.*]). (8)

In an optimal system, the standard deviation of the estimator, std([??]|[[theta].sup.*], can be obtained by the Cramer-Rao lower bound (CRLB). This bound is achievable when the estimator uses information from the vicinity of the true value, [[theta].sup.*]. However, in estimating the direction of sine waves when their phase information is ambiguous (Figure 2), the brain might consider different directions as the true ones. For example, when a continuous 2 kHz tone reaches both ears from either one of the sides or from the front of the head, the produced ITD in all cases will be 0. Thus, when the signal is coming from either of those directions, an optimal estimator can choose any of those possibilities. Since the Barankin lower bound (BLB) [52] takes into account different possible values of the estimated parameter other than those located in the proximity of the true one, the BLB might be a better choice in deriving a lower bound of std([??]|[[theta].sup.*]).

Let us define CRLB([[theta].sup.*]) and BLB([[theta].sup.*]) as the CRLB and the BLB of [[theta].sup.*], respectively. In general,

MAA = std ([??]|[[theta].sup.*]) [greater than or equal to] BLB([[theta].sup.*]) > BLB([[theta].sup.*]). (9)

In order to derive both CRLB([[theta]j.sup.*]) and BLB([[theta].sup.*]), one should consider the probability density function of the estimator [??]|[[theta].sup.*]. The stochastic properties of the estimator [??] | [[theta].sup.*] are initiated by the probabilistic behavior of the neural spike trains along the auditory pathway. Thus, the lower bounds can be derived from the probability density function of the neural spike trains.

The stochastic properties of the neural spike are described by the probability of getting N successive spikes during T seconds at the time instances |[t.sub.1],..., [t.sub.N]| following an acoustic stimulus. As was stated earlier [8, 9], this behavior can be described as NHPP; therefore,

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], (10)

where [lambda](t, [[THETA].bar]) is the instantaneous rate of the neural point process and [[THETA].bar] is a vector that includes all the physical parameters of the audio signal. In this study, since we relate to MAA, we choose [[THETA].bar] = [theta] as the direction of the incoming signal.

In NHPP, both lower bounds, CRLB and BLB, depend only on the instantaneous rate. The CRLB for a NHPP was derived by Bar David [53] and is given by

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (11)

For deriving BLB, we define a vector of L that includes all the nontrue but possible values [[PHI].bar] = [[[theta].sub.1],..., [[theta].sub.L]]. In 37] the BLB was derived for an NHPP which is given by

BLB([[theta].sub.*]) = CRLB([[theta].sup.*]) + ([[phi].bar] - CRLB([[theta].sup.*]) x [A.bar]) [[DELTA].sup.-1] x [([[PHI].bar] - CRLB([[theta].sup.*]) x [A.bar]).sup.T], (12)

where [A.bar] = [[A.sub.1],..., [A.sub.L]] is a vector of length L, when each [A.sub.t] is given by

[A.sub.l] = [[integral].sup.T.sub.0][[[lambda](t, [[theta].sub.l])/[lambda](t, [[theta].sub.*])] - 1] x [partial derivative][lambda](t, [theta]/[partial derivative][theta][|.sub.[theta]=[[theta].sup.*] dt. (13)

The matrix [DELTA] = B - [[A.bar].sup.T]CRLB([[theta].sup.*])[A.bar], where B is a symmetric matrix whose size is L x L. Each element in the matrix B is obtained by

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (14)

The vector [[PHI].bar] is essential in BLB derivation. If the size of the vector is predetermined, the actual values [[theta].sub.1],..., [[theta].sub.L] can be obtained by deriving BLB for all the possibilities. The L directions that yield the maximum BLB are then chosen for vector [[PHI].bar]. Such a straightforward approach is a time-consuming process that requires calculating enormous number of possible sets. For example, for L = 4 with a resolution of 1[degrees], there are [360.sup.4] sets to consider. In order to reduce the number of calculations, a two-stage procedure was designed. In the first stage, for every frequency, BLB predicted MAAs based on a single ambiguity. In a 1[degrees] resolution, a total of 360 BLB derivations were obtained. In the second stage, for every frequency, the number of ambiguous directions (L) was defined and the vector [[[theta].sub.1,..., [[theta].sub.L]] of the ambiguous directions was chosen according to directions that yielded maximum MAA in the first stage.

4. MAA Prediction Based on Auditory Nerve Response

Since the auditory nerve (AN) is the initial stage in the auditory neural pathway, we first tested the prediction of MAA on the basis of its response.

There are about 30,000 AN fibers that innervate each ear. The different location of each fiber's attachment on the cochlear partition determines its frequency sensitivity since each point along the cochlea has a different resonance frequency.

The auditory nerve's instantaneous rate (IR) for a simple tone stimulus s(t) = A x sin(2[pi]ft + [phi]) is commonly expressed with an exponential function [21, 24, 25, 29, 38] which is obtained by

[[lambda].sub.AN](t) = [gamma](f, A) x exp{[gamma](f, A) x B(f) x sin (2[pi]ft + [phi] + [phi] (f))}. (15)

Generally, [gamma](f, A) is a nonlinear function of both the level and frequency of the stimulus. Its minimum value equals the fiber's spontaneous rate while its maximum value is equal to the fiber's saturation rate. For stimuli whose levels are in the mid-range (20 A < 50 dB SPL), as used in this MAA experiment, [gamma](f, A) is proportional to the stimulus level; that is, [gamma](f, A) = A x [[gamma].sub.0](f), where [[gamma].sub.0](f) is different for every fiber as determined by the location along the cochlear partition that the fiber innervates.

The function B(f) governs the synchronization of the fiber response which decreases with the increase of both frequency and the level of the simple tone stimuli. In this study we refer only to the dependence of the synchronization on frequency. The AN synchronization data [30, 54, 55] is commonly modelled by a sigmoid function of the form

B(f) = 1.5 [[e.sup.-[beta] x f]/[1 + [e.sup.-[beta] x f]]], (16)

where [beta] is a constant that determines the loss of the fiber's synchrony as a function of frequency. We chose [beta] = [10.sup.-5] which corresponds to a loss of synchrony at around 3 kHz [38, 54-56].

Since in a MAA experiment both ears are involved, the derivation of MAA will take into account those fibers from the right and left cochleae that are most sensitive to the stimulus frequency. We ignore all other fibers whose IRs are significantly reduced in comparison to the most sensitive fiber. Since the AN fibers are statistically independent [2], therefore the d' theorem can be applied in order to obtain the MAA from N fibers:

[(d').sup.2] = [N.summation over (n=1)][(d'.sub.n]).sup.2], (17)

where N is the number of independent nerve fibers and [d'.sub.n] is the d' (see (7)) that was derived for the nth fiber. Since MAA is obtained when d' = 1, this implies that

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], (18)

where [std.sup.n.sub.R]([??] | [[theta].sup.*]) and [std.sup.n.sub.L]([??] | [[theta].sup.*]) are the standard deviations of the estimator as obtained by the right and left nth AN fibers, respectively, while [N.sub.R](f) and [N.sub.L](f) are the number of fibers of the right and left auditory nerve, respectively. When the optimal estimation is considered, the standard deviation is replaced by the correspondent CRLB (see (11)) or BLB (see (12)).

Figure 3 represents the prediction of MAA based on a BLB derivation with a single ambiguity (L = 1) as a function of both frequency and direction. The derivations were obtained by substituting (15) in 12). Equation (15) was derived for both right and left stimulations by using the correspondent HRIRs (see (2) that yields [[lambda].sub.R](t, d) and [[lambda].sub.L](t, [theta]), the right and left auditory nerve instantaneous rates, respectively. In practice, only the fibers with a characteristic frequency equal to the stimulus frequency contribute to the MAA prediction. For the sake of simplicity, we chose [N.sub.R](f) = [N.sub.L](f) = [N.sub.0]; [y.sub.0](f) = 1 and A = 1. The number of fibers [N.sub.0] was chosen so that CRLB at 500 Hz yielded MAA of 1[degrees].

Throughout the frequency range, high values of MAA were obtained at the rear of the head ([theta] = 180[degrees], [theta] = -180[degrees]). This is most likely due to front-back confusion. At approximately 2 kHz and its harmonics (4 and 8 kHz), relatively high values of MAA were obtained at approximately [theta] = 90[degrees] and [theta] = -90[degrees]. This most likely corresponds to the confusion between right and left. At directions that did not correspond to ambiguity, the values of the bound decreased with frequency.

Figure 4 represents the simulation results of MAA, derived by both lower bounds, CRLB and BLB, as a function of frequency when the reference direction was in front ([[theta].sup.*] = 0). BLB was derived with at most 4 possible directions (L = 4). As can be expected, the estimated MAA according to BLB is greater than the CRLB estimates for all frequencies. At low frequencies, below 1 kHz, MAA according to BLB is about 10 times greater than the one yielded by CRLB. However, a more interesting difference between the two predictions is their dependence on frequency. CRLB derivation yielded a constant MAA of up to about 1 kHz and a monotonic decrease with increasing frequency for frequencies above 1 kHz. The BLB derivation yielded multiple peaks of MAA, in particular around 2, 4, 7, and 9 kHz.

The front-back confusion that exists throughout the whole frequency range is probably the reason for the difference in the MAA estimate according to the BLB and CRLB at low frequencies. Peaks at high frequencies (2, 4, 7, 9 kHz) can be attributed to the ambiguities that correspond to the similar phase obtained from tones coming from the sides or from the front of the head. According to the anthropometric data of the KEMAR dummy head [51], the head width is about 14 cm, which corresponds to a wavelength of tones with frequencies between 1.6 and 2.4 kHz [57]. These are the frequencies that yielded maximum MAA according to the BLB derivation.

While comparing the computational results of Figure 4 to the human performance shown in Figure 1, it seems that neither CRLB nor BLB is good predictors of human performance. By deriving MAA from CRLB, the dependence on frequency is totally different from data based on human performance. According to CRLB, MAA decreases monotonically as opposed to an oscillatory dependence in human experimental data. Although BLB reveals an oscillatory behaviour as a function of frequency, the predicted MAA has more oscillations as a function of frequency than human performance. In the next section we test whether this contradiction can be resolved by taking into account the binaural processing performed by CD cells in the brainstem nuclei such as SOC and IC.

5. MAA Prediction Based on the Superior Olivary Complex CD Cells

Figure 5 presents a schematic representation of part of the brainstem auditory pathway that is involved in binaural processing. The acoustic stimulus entering both ears innervates the auditory nerves. In Figure 5, the auditory nerves are represented by the left and right IRs, [[lambda].sup.(L).sub.AN] and [[lambda].sup.(R).sub.AN], respectively. The ANs stimulate both right and left SOCs. In each SOC, the two types of CD cells, EE and EI, are indicated.

Both EE and EI cells receive two independent inputs, one from each ear as Figure 5 indicates. Following [38], the output of both EE and EI cells is NHPP if the time interval (A) in which the two inputs can interact satisfies the condition [DELTA] [much less than] min{[[tau].sub.R], [[tau].sub.L]}, where [[tau].sub.R] and [[tau].sub.L] are refractory periods of the right and left inputs.

The IR of the EE cells is obtained by

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (19)

Since both right and left EE cells receive similar inputs, their output IRs are also identical; that is,

[[lambda].sup.(R).sub.EE](t, [theta]) = [[lambda].sup.(L).sub.EE] (t, [theta]) = [[lambda].sub.EE] (t, [theta]). (20)

A possible coincidence window length is [[DELTA].sub.EE] = 20 [micro]sec [58]. The value of this length, which was previously used in theoretical models [24, 25, 29], satisfies the condition [[DELTA].sub.EE] [much less than] min{[[tau].sub.R], [[tau].sub.L]}, since the refractory period at the auditory nerve is in the order of 500 [micro]sec to 1 m sec [59-62].

EI cells receive excitatory and inhibitory inputs. An EI in the right SOC (Figure 5) receives an excitatory input from the left side and an inhibitory input from the right side that yields

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (21)

On the other hand, an EI cell in the left SOC receives the antisymmetric inputs, that is, an excitatory input from the right side and an inhibitory input from the left side (Figure 5) that yields

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (22)

A possible coincidence window length is [[DELTA].sub.EI] = 200 [micro]sec [34]. This length is ten times longer than what was used in EE cells. However, it satisfies the condition [[DELTA].sub.EI] < min{[[tau].sub.R], [[tau].sub.L]}, which guarantees that EI cells behave as NHPP if their inputs also behave as NHPP [37].

In deriving MAA from the SOC CD cells, we assume that the outputs of the EE and EI cells are statistically independent. Therefore, MAA can be derived by using the d' theorem (see (17)) which implies that

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], (23)

where [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], and [std.sup.(L).sub.EI] ([??] | [[theta].sup.*]) are the standard deviations of the estimator that were obtained by the right and left EEs and the right and left EI cells, respectively. The values [N.sup.(R).sub.EE](f), [N.sup.(L).sub.EE](f), [N.sup.(R).sub.EI](f), and [N.sup.(L).sub.EI](f) are the number of the right and left EE and EI cells at the SOC. When the optimal estimation is considered, the standard deviations are replaced by the correspondent lower bounds, CRLB (see (11)) or BLB with L = 4 (see (12)). The relevant instantaneous rates are obtained by substituting the EE IRs (see (19)) and the EI IRs (see (21) and 22)).

In order to demonstrate the difference between the MAA derivations as obtained by EE and EI cells, we calculated (23) with either a single EE cell ([N.sup.(R).sub.EE](f) = [N.sup.(R).sub.EE](f) = 1; [N.sup.(R).sub.EI](f) = [N.sup.(R).sub.EI](f) = 0) or a single EI cell ([N.sup.(R).sub.EE](f) = [N.sup.(R).sub.EE](f) = 0; [N.sup.(R).sub.EI](f) = [N.sup.(L).sub.EI](f) = 1). Figure 6 exhibits the resulting derivations as a function of frequency for a reference azimuth of 0[degrees]. According to CRLB, both EE and EI yielded a monotonic decrease as a function of frequency. But EE yielded a MAA with an order of magnitude greater than the one predicted from the EI response. On the other hand, the MAA that the EI yielded was similar to the one obtained by the AN response (Figure 4). One can then conclude that at the SOC level, EI processing caused minor information loss. However, due to EE processing some of the information that was included in the AN was lost.

When the MAA prediction was based on the BLB derivation (Figure 6(b)), both EE and EI yielded an oscillatory behavior as a function of frequency. When EE response was considered, the predicted MAA revealed local maxima at around 1.3 and 8 kHz, whereas the EI response yielded local maxima at 3.5 and 8 kHz.

It is clear from Figure 6 that both EE and EI are required in order to match the experimental results (Figure 1). Figure 7 represents the predicted MAA according to BLB with the following choice EE and EI cells:

[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]. (24)

Note that (24) is consistent with physiological data indicating that EE cells mostly innervate signals with low frequencies, while EI cells are most sensitive to signals with high frequencies (e.g., [31, 32]). The predicted MAA has 2 peaks at about the same locations as the experimental data.

6. Discussion

The stochastic properties of neural spike trains in the auditory pathway were used in order to predict human performance in sound localization. We have shown that it is possible to predict human performance in an MAA experiment based on simple tones.

As in any JND experiment, predicting human performance was based on two main assumptions: (1) the brain is an unbiased optimal processor and (2) the neural spike trains behave as NHPP. The methodology involved deriving lower bounds based on the stochastic properties of neural spike trains [21, 22, 24, 25, 38].

When JND is predicted by deriving a lower bound, its significance is obtained by comparing it to experimental results as a function of a physical parameter. In this paper, we compared the bound prediction of MAA as a function of the stimulus frequency.

In an MAA experiment with simple tones, the information about the origin of the stimulus might be ambiguous at high frequencies. We have shown that the ambiguous interpretation of the HRTF phase data is probably the reason for the oscillatory behaviour of MAA as a function of frequency in human performance. This was demonstrated by the usage of two lower bounds, CRLB and BLB. In general, one can expect that the predictions of BLB will be greater than those obtained by CRLB. But the derivation demonstrated in this study reveals a totally different dependency on frequency. CRLB that took into account only the approximate true origin of the stimulus failed to predict oscillatory behavior. On the other hand, BLB, which considered ambiguity, succeeded in predicting the oscillatory behavior.

We further compared the predictions that were based on the AN outputs with those obtained by the SOC outputs. Although, both BLB predictions yielded an oscillatory behavior, it seems that the SOC output obtained a better prediction in respect to psychoacoustical data. When the AN output was considered, MAA local maxima were derived at frequencies 1.5, 2, 4, 7, and 9 kHz (Figure 4). When SOC was considered, some of the local maxima disappeared. It seems that loss of information due the SOC processing reduced the effect of the phase ambiguity.

The SOC outputs were derived by CD cells that processed the binaural information. The main task of CD cells is probably to extract binaural cues, with EE cells most likely extracting ITD and the EI cells extracting ILD [31, 32, 38]. Both ITD and ILD contribute to estimating the signal direction. In fact, our calculation of MAA, as derived by BLB, has shown that both EE and EI cells are required for predicting the experimental results.

We expect that the brain as an optimal system seeks to achieve a monotonic descending dependency of MAA as a function of frequency as predicted by CRLB. However, the physical constraints (i.e., the ambiguous phases) prevent the brain from achieving this goal.

When MAA was derived from the AN response or a single EI response, the predicted MAA according to BLB derivation was ten times greater than that predicted by CRLB at low frequencies (below 1.5 kHz). This difference was explained by the front-back confusion. However, this effect was almost eliminated when the EE response was considered. At low frequencies, the nerve response is synchronized to the stimulus; that is, B(f) [right arrow] 1 in (16). Although the synchronization exists in the AN response, it was not sufficient for overcoming the front-back confusion. However, it played an important role at the SOC level where ITD was efficiently extracted [38]. Therefore, at the SOC level, at low frequencies, both lower bounds, CRLB and BLB, yielded almost the same MAA.

The methodology used in this study was to express the lower bounds by analytical expressions as derived in [21, 24, 25, 38]. This was possible, since we assumed that the neural spike trains behave as NHPP at AN. However, in using this assumption, the discharge history including the refractory period, which is a basic characteristic of every neuron [6368], was ignored. Other models of neural spike trains that take into account the refractory period might be a better choice for describing the neural spike trains [66, 69-73]. Yet, the usage of the NHPP model and the outcome lower bounds approach has been successful in predicting several additional properties of the auditory system. Consider, for example, (1) the prediction of level and frequency discrimination as a function of the stimulus duration, level, and frequency [21, 24], and (2) ITD and ILD as a function of frequency [38]. In these studies it seems that the NHPP approach is adequate for describing steady-state responses of continuous stimuli [74-76].

This study aimed to show the potential in using lower bounds in order to predict human performance in psychoacoustical experiments and particularly the importance of considering ambiguous information. However, we do not claim that the simple model presented in this paper is the exact biological model. Further research is required in order to quantitatively predict human performances. Such studies should include a generalized cochlear model, a synapse model, and models of the brainstem nuclei.

http://dx.doi.org/10.1155/2014/575716

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

This study was partially supported by the Israel Science Foundation Grant no. 563/12.

References

[1] E. D. Adrian, "The impulses produced by sensory nerve endings," The Journal of Physiology, vol. 61, no. 2, pp. 151-171, 1926.

[2] N. Y. S. Kiang, T. Watanabe, E. C. Thomas, and L. F. Clark, Discharge Patterns of Single Fibers in the Cat's Auditory Nerve, MIT Press, Cambridge, Mass, USA, 1965.

[3] A. Manwani and C. Koch, "Detecting and estimating signals in noisy cable structures, I: neuronal noise sources," Neural Computation, vol. 11, no. 8, pp. 1797-1829, 1999.

[4] J. A. White, J. T. Rubinstein, and A. R. Kay, "Channel noise in neurons," Trends in Neurosciences, vol. 23, no. 3, pp. 131-137, 2000.

[5] E. Schneidman, B. Freedman, and I. Segev, "Channel stochastic ity may be critical in determining the reliability and precision of spike timing," Neural Computation, vol. 10, no. 7, pp. 1679-1703, 1998.

[6] L. Alaoglu and N. M. Smith Jr., "Statistical theory of a scaling circuit," Physical Review, vol. 53, no. 10, pp. 832-836, 1938.

[7] R. W. Rodieck, N. Y.-S. Kiang, and G. L. Gerstein, "Some quantitative methods for the study of spontaneous activity of single neurons," Biophysical Journal, vol. 2, pp. 351-368, 1962.

[8] P. R. Gray, "Conditional probability analyses of the spike activity of single neurons," Biophysical Journal, vol. 7, no. 6, pp. 759-777, 1967.

[9] F. Rieke, D. Warland, R. D. R. van Steveninck, and W. Bialek, Spikes Exploring the Neural Code, MIT Press, Cambridge, Mass, USA, 1997

[10] A. Wald, "Foundations of a general theory of sequential decision functions," Econometrica, vol. 15, no. 4, pp. 279-313, 1947

[11] A. W. Mills, "On the minimum audible angle," The Journal of the Acoustical Society of America, vol. 30, no. 2, pp. 237-246, 1958.

[12] H. Levitt, "Transformed up-down methods in psychoacoustics," The Journal of the Acoustical Society of America, vol. 49, no. 2, pp. 467-477, 1971.

[13] R. G. Klumpp and H. R. Eady, "Some measurements of inter-aural time difference thresholds," The Journal of the Acoustical Society of America, vol. 28, no. 5, pp. 859-860, 1956.

[14] J. Zwislocki and R. S. Feldman, "Just noticeable differences in dichotic phase," The Journal of the Acoustical Society of America, vol. 28, no. 5, pp. 860-864, 1956.

[15] A. W. Mills, "Lateralization of high-frequency tones," The Journal of the Acoustical Society of America, vol. 32, no. 1, pp. 132-134, 1960.

[16] R. M. Hershkowitz and N. I. Durlach, "Interaural time and amplitude jnds for a 500-Hz tone," The Journal of the Acoustical Society of America, vol. 46, no. 6, pp. 1464-1467, 1969.

[17] D. H. Klatt, "Discrimination of fundamental frequency contours in synthetic speech: implications for models of pitch perception," The Journal of the Acoustical Society of America, vol. 53, no. 1, pp. 8-16, 1973.

[18] L. Demany and C. Semal, "Detection thresholds for sinusoidal frequency modulation," The Journal of the Acoustical Society of America, vol. 85, no. 3, pp. 1295-1301, 1989.

[19] J. H. Johnson, C. W. Turner, J. J. Zwislocki, and R. H. Margolis, "Just noticeable differences for intensity and their relation to loudness," The Journal of the Acoustical Society of America, vol. 93, no. 2, pp. 983-991, 1993.

[20] J. Lyzenga and J. W. Horst, "Frequency discrimination of bandlimited harmonic complexes related to vowel formants," The Journal of the Acoustical Society of America, vol. 98, no. 4, pp. 1943-1955, 1995.

[21] W. M. Siebert, "Stimulus transformation in the peripheral auditory system," in Recognizing Patterns, P. A. Kolers and M. Eden, Eds., pp. 104-133, MIT Press, Cambridge, Mass, USA, 1968.

[22] W. M. Siebert, "Frequency discrimination in the auditory system: place or periodicity mechanisms?" vol. 58, no. 5, pp. 723-730, 1970.

[23] M. G. Heinz, Quantifying the effects of the cochlear amplifier on temporal and average-rate information in the auditory nerve [Ph.D. dissertation], Massachusetts Institute of Technology, Cambridge, Mass, USA, 2000.

[24] M. G. Heinz, H. S. Colburn, and L. H. Carney, "Evaluating auditory performance limits: I. One-parameter discrimination using a computational model for the auditory nerve," Neural Computation, vol. 13, no. 10, pp. 2273-2316, 2001.

[25] H. S. Colburn, "Theory of binaural interaction based on auditory nerve data. I. General strategy and preliminary results on interaural discrimination," The Journal of the Acoustical Society of America, vol. 54, no. 6, pp. 1458-1470, 1973.

[26] R. M. Stern Jr. and H. S. Colburn, "Theory of binaural interaction based on auditory-nerve data. IV. A model for subjective lateral position," The Journal of the Acoustical Society of America, vol. 64, no. 1, pp. 127-140, 1978.

[27] L. G. Huettel and L. M. Collins, "A theoretical comparison of information transmission in the peripheral auditory system: normal and impaired frequency discrimination," Speech Communication, vol. 39, no. 1-2, pp. 5-21, 2003.

[28] L. G. Huettel and L. M. Collins, "Predicting auditory tone-in-noise detection performance: the effects of neural variability," IEEE Transactions on Biomedical Engineering, vol. 51, no. 2, pp. 282-293, 2004.

[29] O. Cohen, M. Furst, and R. Krips, "ITD and ILD estimation based on neural stochastic analysis," in Proceedings of the 23rd IEEE Convention of Electrical and Electronics Engineers in Israel, pp. 185-188, September 2004.

[30] J. E. Rose, J. F. Brugge, D. J. Anderson, and J. E. Hind, "Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey," Journal of Neurophysiology, vol. 30, no. 4, pp. 769-793, 1967.

[31] J. M. Goldberg and P. B. Brown, "Response of binaural neurons of dog superior olivary complex to dichotic tonal stimuli: some physiological mechanisms of sound localization," Journal of Neurophysiology, vol. 32, no. 4, pp. 613-636, 1969.

[32] T. C. Yin and J. C. Chan, "Interaural time sensitivity in medial superior olive of cat," Journal of Neurophysiology, vol. 64, no. 2, pp. 465-488, 1990.

[33] D. McAlpine, D. Jiang, T. M. Shackleton, and A. R. Palmer, "Convergent input from brainstem coincidence detectors onto delay-sensitive neurons in the inferior colliculus," The Journal of Neuroscience, vol. 18, no. 15, pp. 6026-6039, 1998.

[34] T. J. Park, "IID sensitivity differs between two principal centers in the interaural intensity difference pathway: the LSO and the IC," Journal of Neurophysiology, vol. 79, no. 5, pp. 2416-2431, 1998.

[35] A. J. Smith, S. Owens, and I. D. Forsythe, "Characterisation of inhibitory and excitatory postsynaptic currents of the rat medial superior olive," The Journal of Physiology, vol. 529, no. 3, pp. 681698, 2000.

[36] A. R. Palmer, T. M. Shackleton, and D. McAlpine, "Neural mechanisms of binaural hearing," Acoustical Science and Technology, vol. 23, no. 2, pp. 61-68, 2002.

[37] R. Krips and M. Furst, "Stochastic properties of coincidence-detector neural cells," Neural Computation, vol. 21, no. 9, pp. 2524-2553, 2009.

[38] R. Krips and M. Furst, "Stochastic properties of auditory brainstem coincidence detectors in binaural perception," The Journal of the Acoustical Society of America, vol. 125, no. 3, pp. 1567-1583, 2009.

[39] W. B. Warr, "Fiber degeneration following lesions in the anteroventral cochlear nucleus of the cat," Experimental Neurology, vol. 23, pp. 140-155, 1966.

[40] J. J. Guinan, S. S. Guinan, and B. E. Norris, "Single auditory units in the superior olivary complex. I: responses to sounds and classifications based on physiological properties," International Journal of Neuroscience, vol. 4, no. 3, pp. 101-120, 1972.

[41] P. X. Joris, L. H. Carney, P. H. Smith, and T. C. T. Yin, "Enhancement of neural synchronization in the anteroventral cochlear nucleus. I. Responses to tones at the characteristic frequency," Journal of Neurophysiology, vol. 71, no. 3, pp. 1022-1036, 1994.

[42] J. C. Boudreau and C. Tsuchitani, "Cat superior olive S-segment cell discharge to tonal stimulation," Contributions to Sensory Physiology, vol. 4, pp. 143-213, 1970.

[43] D. Caird and R. Klinke, "Processing of binaural stimuli by cat superior olivary complex neurons," Experimental Brain Research, vol. 52, no. 3, pp. 385-399, 1983.

[44] D. M. Caspary and P. G. Finlayson, "Superior olivary complex: functional neuropharmacology of the principal cell types," in Neurobiology of Hearing: The Central Auditory System, R. A. Altschuler, R. P. Bobbin, B. M. Clopton, and D. W. Hoffman, Eds., pp. 141-161, Raven Press, New York, NY, USA, 1991.

[45] D. J. Tollin and T. C. T. Yin, "The coding of spatial location by single units in the lateral superior olive of the cat. I. Spatial receptive fields in azimuth," The Journal of Neuroscience, vol. 22, no. 4, pp. 1454-1467, 2002.

[46] J. D. Harris, "A florilegium of experiments on directional hearing," Acta Oto-Laryngologica, vol. 298, pp. 1-26, 1972.

[47] D. W. Grantham, "Detection and discrimination of simulated motion of auditory targets in the horizontal plane," The Journal of the Acoustical Society of America, vol. 79, no. 6, pp. 1939-1949, 1986.

[48] E. R. Hafter, T. N. Buell, D. A. Basiji, and E. E. Shriberg, "Discrimination of direction for complex sounds presented in the free-field," in Basic Issues in Hearing: Proceedings of the 8th International Symposium on Hearing, H. Duifhuis, J. W. Horst, and H. P. Wit, Eds., pp. 394-401, Academic Press, London, UK, 1988.

[49] R. Y. Litovsky and N. A. Macmillan, "Sound localization precision under conditions of the precedence effect: effects of azimuth and standard stimuli," The Journal of the Acoustical Society of America, vol. 96, no. 2, pp. 752-758, 1994.

[50] D. W. Grantham, B. W. Y. Hornsby, and E. A. Erpenbeck, "Auditory spatial resolution in horizontal, vertical, and diagonal planes," The Journal of the Acoustical Society of America, vol. 114, no. 2, pp. 1009-1022, 2003.

[51] V. R. Algazi, R. O. Duda, D. M. Thompson, and C. Avendano, "The CIPIC HRTF database," in Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 99-102, New Platz, NY, USA, October 2001.

[52] E. W. Barankin, "Locally best unbiased estimates," The Annals of Mathematical Statistics, vol. 20, no. 4, pp. 477-628, 1949.

[53] I. Bar David, "Communication under the Poisson regime," IEEE Transactions on Information Theory, vol. 15, no. 1, pp. 31-37, 1969.

[54] A. R. Palmer and I. J. Russell, "Phase-locking in the cochlear nerve of the guinea-pig and its relation to the receptor potential of inner hair-cells," Hearing Research, vol. 24, no. 1, pp. 1-15, 1986.

[55] D. H. Johnson, "The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones," The Journal of the Acoustical Society of America, vol. 68, no. 4, pp. 1115-1122, 1980.

[56] A. D. Reyes, E. W. Rubel, and W. J. Spain, "In vitro analysis of optimal stimuli for phase-locking and time-delayed modulation of firing in avian nucleus laminaris neurons," The Journal of Neuroscience, vol. 16, no. 3, pp. 993-1007, 1996.

[57] G. F. Kuhn, "Physical acoustics and measurements pertaining to directional hearing," in Directional Hearing, W. A. Yost and G. Gourevitch, Eds., pp. 3-25, Springer, New York, NY, USA, 1987.

[58] H. Agmon-Snir, C. E. Carr, and J. Rinzel, "The role of dendrites in auditory coincidence detection," Nature, vol. 393, no. 6682, pp. 268-272, 1998.

[59] C. A. Miller, P. J. Abbas, and B. K. Robinson, "Response properties of the refractory auditory nerve fiber," Journal of the Association for Research in Otolaryngology, vol. 2, no. 3, pp. 216-232, 2001.

[60] S. Dynes, Discharge characteristics of auditory nerve fibers for pulsatile electrical stimuli [Ph.D. thesis], Massachusetts Institute of Technology, Cambridge, Mass, USA, 1996.

[61] I. C. Bruce, L. S. Irlicht, M. W. White et al., "A stochastic model of the electrically stimulated auditory nerve: pulse- train response," IEEE Transactions on Biomedical Engineering, vol. 46, no. 6, pp. 630-637, 1999.

[62] C. J. Brown and P. J. Abbas, "Electrically evoked whole-nerve action potentials: parametric data from the cat," The Journal of the Acoustical Society of America, vol. 88, no. 5, pp. 2205-2210, 1990.

[63] R. P. Gaumond, D. O. Kim, and C. E. Molnar, "Response of cochlear nerve fibers to brief acoustic stimuli: role of discharge-history effects," The Journal of the Acoustical Society of America, vol. 74, no. 5, pp. 1392-1398, 1983.

[64] M. C. Teich, L. Matin, and B. I. Cantor, "Refractoriness in the maintained discharge of the cat's retinal ganglion cell," Journal of the Optical Society of America, vol. 68, no. 3, pp. 386-402, 1978.

[65] M. J. Berry, D. K. Warland, and M. Meister, "The structure and precision of retinal spike trains," Proceedings of the National Academy of Sciences of the United States of America, vol. 94, no. 10, pp. 5411-5416, 1997

[66] M. J. Berry II and M. Meister, "Refractoriness and neural precision," The Journal of Neuroscience, vol. 18, no. 6, pp. 2200-2211, 1998.

[67] D. R. Cox and P. A. W. Lewis, The Statistical Analysis of Series of Events, Methuen, London, UK, 1966.

[68] D. H. Perkel, G. L. Gerstein, and G. P. Moore, "Neuronal spike trains and stochastic point processes. I. The single spike train," Biophysical Journal, vol. 7, no. 4, pp. 391-418, 1967

[69] D. H. Johnson and A. Swami, "The transmission of signals by auditory-nerve fiber discharge patterns," The Journal of the Acoustical Society of America, vol. 74, no. 2, pp. 493-501, 1983.

[70] L. H. Carney, "A model for the responses of low-frequency auditory-nerve fibers in cat," The Journal of the Acoustical Society of America, vol. 93, no. 1, pp. 401-417, 1993.

[71] M. C. Teich, "Fractal character of the auditory neural spike train," IEEE Transactions on Biomedical Engineering, vol. 36, no. 1, pp. 150-160, 1989.

[72] M. C. Teich and S. B. Lowen, "Fractal patterns in auditory nerve-spike trains," IEEE Engineering in Medicine and Biology Magazine, vol. 13, no. 2, pp. 197-202, 1994.

[73] J. Keat, P. Reinagel, R. C. Reid, and M. Meister, "Predicting every spike: a model for the responses of visual neurons," Neuron, vol. 30, no. 3, pp. 803-817, 2001.

[74] P. A. W. Lewis and G. S. Shedler, "Simulation methods for Poisson processes in nonstationary systems," in Proceedings of the 10th Conference on Winter Simulation (WSC '78), vol. 1, pp. 155-163, 1978.

[75] T. C. Brown, "Poisson approximations and the definition of the Poisson process," The American Mathematical Monthly, vol. 91, no. 2, pp. 116-123, 1984.

[76] D. L. Snyder and M. I. Miller, Random Point Processes in Time and Space, Springer, Berlin, Germany, 1991.

Ram Krips and Miriam Furst

The School of Electrical Engineering, Faculty of Engineering, Tel Aviv University, 69978 Tel Aviv, Israel

Correspondence should be addressed to Miriam Furst; mira@eng.tau.ac.il

Received 15 September 2013; Revised 6 February 2014; Accepted 2 March 2014; Published 31 March 2014

Academic Editor: Asohan Amarasingham

Printer friendly Cite/link Email Feedback | |

Author: | Krips, Ram; Furst, Miriam |
---|---|

Publication: | Computational Intelligence and Neuroscience |

Article Type: | Report |

Date: | Jan 1, 2014 |

Words: | 7877 |

Previous Article: | Safety assessment of dangerous goods transport enterprise based on the relative entropy aggregation in group decision making model. |

Next Article: | Robust fault detection of wind energy conversion systems based on dynamic neural networks. |

Topics: |