Skip Navigation


Brain Advance Access originally published online on September 23, 2003
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
126/12/2616    most recent
awg265v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (30)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Aschenbrenner-Scheibe, R.
Right arrow Articles by Schulze-Bonhage, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Aschenbrenner-Scheibe, R.
Right arrow Articles by Schulze-Bonhage, A.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Brain, Vol. 126, No. 12, 2616-2626, December 2003
© 2003 Guarantors of Brain
doi: 10.1093/brain/awg265

How well can epileptic seizures be predicted? An evaluation of a nonlinear method

R. Aschenbrenner-Scheibe1,2, T. Maiwald1,2, M. Winterhalder1,2, H. U. Voss2, J. Timmer2 and A. Schulze-Bonhage1

1 Epilepsy Centre and 2 Freiburg Centre for Data Analysis and Modelling, University of Freiburg, Freiburg, Germany

Correspondence to: Dr Andreas Schulze-Bonhage, Epilepsy Centre, University of Freiburg, Breisacher Strasse 64, 79106 Freiburg, Germany E-mail: schulzeb{at}nz.ukl.uni-freiburg.de

Received December 4, 2002. Revised April 1, 2003. Accepted June 20, 2003.


    Summary
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
The unpredictability of the occurrence of epileptic seizures contributes to the burden of the disease to a major degree. Thus, various methods have been proposed to predict the onset of seizures based on EEG recordings. A nonlinear feature motivated by the correlation dimension is a seemingly promising approach. In a previous study this method was reported to identify ‘preictal dimension drops’ up to 19 min before seizure onset, exceeding the variability of interictal data sets of 30–50 min duration. Here we have investigated the sensitivity and specificity of this method based on invasive long-term recordings from 21 patients with medically intractable partial epilepsies, who underwent invasive pre-surgical monitoring. The evaluation of interictal 24-h recordings comprising the sleep–wake cycle showed that only one out of 88 seizures was preceded by a significant preictal dimension drop. In a second analysis, the relation between dimension drops within time windows of up to 50 min before seizure onset and interictal periods was investigated. For false-prediction rates below 0.1/h, the sensitivity ranged from 8.3 to 38.3% depending on the prediction window length. Overall, the mean length and amplitude of dimension drops showed no significant differences between interictal and preictal data sets.

Keywords: epilepsy; false-prediction rate; intracranial EEG; nonlinear analysis; seizure prediction

Abbreviations: FPR = false-prediction rate


    Introduction
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
Epilepsy is characterized by sudden recurrent and transient disturbances of perception or behaviour resulting from excessive synchronization of cortical neuronal networks. Owing to the sudden and unforeseeable occurrence of epileptic seizures, everyday activities are impaired and can become dangerous for patients (Cockerell et al., 1994Go). The unpredictability of seizure onset is one of the most important causes of morbidity and stress in patients with epilepsy (Murray, 1993Go; Buck et al., 1997Go). Being able to predict the onset of seizures would render the implementation of alarm systems and novel therapeutic approaches possible; e.g. automated interventional measures like the application of anticonvulsant drugs or electrical brain stimulation (Stein et al., 2000Go). In addition, the identification of a pre-seizure state could contribute to the investigation of the pathophysiological mechanisms causing seizures.

Recently, there has been growing interest in whether methods from nonlinear dynamics are able to identify preictal states from EEG recordings (Iasemidis et al., 1990Go, 1997Go; Pijn et al., 1991Go, 1997Go; Pritchard and Duke, 1992Go; Lehnertz and Elger, 1995Go, 1998Go; Pritchard et al., 1995Go; Martinerie et al., 1998Go; Osorio et al., 1998Go; Schiff, 1998Go; Moser et al., 1999Go; Jerger et al., 2001Go; Le Van Quyen et al., 2001bGo; Lai et al., 2002Go; Navarro et al., 2002Go; Osorio et al., 2002Go; Winterhalder et al., 2003Go; for recent reviews see Lehnertz et al., 2001Go; Le Van Quyen et al., 2001aGo; Litt and Lehnertz, 2002Go; Litt and Echauz, 2002Go). Seizure prediction times from minutes to hours have been reported.

In a pioneering work, the group of Lehnertz and Elger applied a nonlinear feature motivated by the correlation dimension to intracranial EEG data recorded from the seizure focus (Lehnertz and Elger 1995Go, 1998Go; Lehnertz et al., 2001Go). They observed reductions in the dimensional complexity of brain activity immediately preceding seizures. ‘Dimension drops’ of sufficient amplitude and duration were regarded as a specific feature defining seizure preceding states. Such seizure-preceding states were found to last up to 25 min. In a study with data from patients with mesial temporal lobe epilepsy of hippocampal origin and neocortical lesional epilepsy, 67% of the seizures from the hippocampal group and 29% of the seizures in the neocortical group were preceded by predictive dimension drops (Lehnertz et al., 2001Go).

These studies were based only on low numbers of seizures per patient and short interictal data segments. The acceptance of seizure-preceding dimension drops as predictive, however, depends critically on the variability of the dimension during the interictal periods evaluated. As Litt and Lehnertz (2002)Go pointed out, seizure prediction methods should be assessed based on long-term EEG recordings. We have thus used contiguous data segments over 24 h, including circadian variations, to validate the potential of the correlation dimension method to predict seizures.

As the sensitivity of preictal dimension drops directly preceding seizures turned out to be low when evaluated based on long-term interictal data, we extended our analysis by accepting false predictions and analysing longer time windows preceding seizure onset. This allowed for a combined evaluation of specificity and sensitivity based on clinical requirements and the comparison of the method with an unspecific random alert system.


    Material and methods
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
Patients
Invasive EEG recordings from 21 patients with medically intractable focal epilepsy of temporal and extratemporal origin were used for this study. Their clinical characteristics are summarized in Table 1. All patients underwent a complete presurgical evaluation comprising high resolution MRI, functional imaging, neuropsychological evaluation, and video telemetry with interictal and ictal surface and invasive EEG recordings. Patients with intracranial electrodes were chosen in order to study EEG data within the epileptogenic zone at high signal-to-noise ratio. Intracranial recordings were performed via stereotactically implanted depth electrodes, and via subdural strip and grid electrodes implanted through burr holes or open skull surgery, respectively. The positions of intracranially implanted electrodes were identified on reconstructed 3D MRI data sets (Schulze-Bonhage et al., 2002Go). All patients gave their informed consent to the evaluation of their EEG data. Retrospective evaluation of data was approved by the Ethics Committee, Medical Faculty, University of Freiburg.


View this table:
[in this window]
[in a new window]
 
Table 1 Clinical data and characteristics of selected patients
 
EEG data acquisition
EEG data acquisition was performed with a Neurofile NT digital video EEG system (it-med, Usingen, Germany), with 128 channels, 256 or 512 Hz sampling rate, and a 16 bit analogue-to-digital converter. Data were bandpass filtered between 0.53 and 80 Hz. Filtering at 0.53 Hz was necessary to improve the stationarity of the data and to remove trends (van der Heyden et al., 1999Go). A 50 Hz notch filter was applied to remove line noise. The data were continuously recorded from implantation to explantation of the electrodes. All EEG and video data were visually inspected by board-certified epileptologists. Major events, both clinical and electroencephalographic, were marked in the EEG data files. Preictal data sets from 88 clinically manifest seizures (30 seizures with hippocampal origin, mean of 3.8 seizures per patient; 58 seizures with neocortical origin, mean of 4.5 seizures per patient) were analysed. For a given patient, either all available or five consecutive seizures were used. Each preictal data set contained at least 50 min of preictal data. At least 24 h of interictal data per patient (total 509 h) was used, comprising circadian rhythms including a complete sleep–wake cycle. The median of the time periods between the last seizure preceding the interictal data set was 5 h 18 min, the median of the time periods between the interictal data set and the first following seizure was 9 h 36 min. For each patient, three intracranial electrodes located in or in close proximity to the seizure onset zone were evaluated (Fig. 1). These electrodes were referenced to an electrode displaying only a minimal amount of epileptic activity.



View larger version (23K):
[in this window]
[in a new window]
 
Fig. 1 Implantation scheme with electrode configuration from a non-lesional patient with right hippocampal seizure onset zone. Left: Ten-contact depth electrode (HR) implanted from an occipital approach into the right hippocampus with the most anterior contact situated in the amygdala. Middle: Subdural strip electrodes (temporo-basal on right side), TBa and TBb (four contacts each) in rostral and mesial direction, TBc (six contacts) in occipital direction. Right: Subdural grid electrode covering the lateral temporal and parietal right convexity. The three contacts selected for this study are marked with filled circles.

 
Calculation of the correlation dimension
The effective correlation dimension D2eff is a nonlinear feature that is motivated by the correlation dimension D2 (Grassberger and Procaccia, 1983Goa, b). D2 is a measure for the fractality of the attractor of a low-dimensional, deterministic, stationary, dynamical system. The correlation dimension is obtained by first calculating a correlation sum Cm(r) for a collection of K points embedded in a reconstructed m-dimensional phase space (Takens, 1981Go). This sum counts the fraction of all pairs of points yi, yj that are closer than a given distance r (Theiler, 1986Go; Kantz and Schreiber, 1997Go)

where {theta} is the Heaviside step function ({theta}(x) = 0 if x <= 0, {theta}(x) = 1 if x > 0) and Np = (KW + 1)(KW)/2 is a normal ization factor (with a Theiler correction of W points). In the limit of an infinite amount of data and for large enough m and for small r, Cm(r) is expected to scale with a power law, Cm(r) {propto} rD2, and the correlation dimension D2 is defined by:

If applied to measured data, existence of a proper scaling is not necessarily given. To establish a scaling behaviour, local slopes C'm(r) = dlogCm(r)/dlogr of the correlation sum should be calculated (Kantz and Schreiber, 1997Go).

We followed the operational method of Lehnertz and Elger (1998)Go to obtain an effective scaling region from the local slopes C'm(r) of the correlation sums. An average D* over the number of points Nr of r values in the interval [rl, ru] of C'm(r) between a lower bound of the hypersphere radius rl and an upper bound ru defines the effective correlation dimension

The upper bound ru is attributed to the largest r where C'm(ru, m = 1) > 0.975. The lower bound rl is defined as:

rl = min{r < ru||C'mmax (ru) – C'mmax (r)| <= {delta}},

with {delta} = 0.05 C'mmax (ru), mmax = 25.

Finally, D2eff is given as:

If no scaling region could be determined, D2eff was set to the default value of 10. D2eff was calculated for the interictal and the preictal data sets of patient data. For each electrode, channel sample correlation integrals according to Equation 1 were calculated for moving data window epochs of 4096 data points. These epochs were shifted along the EEG sequence with 2048 points overlap. The time series was embedded into m-dimensional phase space (m = 25) with a delay {tau} = 2 sampling points, and W = 8 sampling points. To smoothen the output curve of the D2eff data, a median filter over three data points was applied.

Definition of predictive dimension drops
According to Lehnertz et al. (2001)Go, a preictal dimension drop is considered predictive: (i) if it is confined to the epileptogenic area; (ii) if it directly precedes a seizure; and (iii) if preictal dimension drop parameters, duration and amplitude, exceed the maximum values of interictal dimension drops (determined per electrode). Figure 2 depicts the definition of the parameters of an interictal and of a preictal dimension drop, the latter of which directly precedes a seizure. For each recording site from all interictal data sets for each patient, the mean interictal level Davg is determined. For interictal data sets, ti is defined as the longest time interval with D2eff below Davg. For preictal data, tp is the time interval between seizure onset and the previous downward crossing of D2eff with Davg. At seizure onset, D2eff has to be smaller than Davg. The maximum deflections di and dp are defined as the maximum differences between D2eff and Davg during ti and tp, respectively. As there is no natural order relation in the 2D parameter space, we first determined ti for each interictal data set and then measured di within this drop.



View larger version (9K):
[in this window]
[in a new window]
 
Fig. 2 Schematic illustration of interictal (left) and preictal (right) dimension drops of the D2eff feature over time. The dashed line represents the average Davg of all interictal data for each patient and recording site. For interictal data, the time interval ti is defined as the interval between two crossings of D2eff with Davg. For a dimension drop that directly precedes a seizure (shaded area), the D2eff feature must be below Davg at seizure onset (marked in preictal data set by upward arrow). The time interval tp is defined as the interval between seizure onset and the last crossing of D2eff with Davg. The amplitude deflections di and dp are defined as the difference between the minimum of D2eff and Davg during ti and tp, respectively.

 
Evaluation
To evaluate the dimension drops obtained from the effective correlation dimension method, two kinds of analyses were performed. First, it was investigated for each electrode whether dimension drops were predictive according to the three requirements of the above definition. Preictal dimension drops which directly precede a seizure were identified and the parameters tp and dp were compared with the maximal parameters from the interictal data sets. Secondly, in order to evaluate specificity and sensitivity of the method in consideration of clinical demands, the drops were analysed under less strict requirements. Instead of requirement (ii), that predictive preictal dimension drops had to precede seizures, they were evaluated within a predefined time window before seizure onset. This conforms to analogous analyses done by other groups (Martinerie et al., 1998Go; Le Van Quyen et al., 1999Go; Litt et al., 2001Go). The mean values tp,avg, dp,avg, ti,avg and di,avg, and the medians tp,med, dp,med, ti,med and di,med of the parameters of the dimension drops, and of all drops with tp, ti >= 80 s, corresponding to 10 data points of D2eff, were calculated for the preictal and the interictal period, respectively. Requirement (iii) was loosened, in that dimension drop parameters regarded as predictive did not have to exceed maximum values of interictal parameters. This led to an optimization method for an alarm system suitable for online analysis as explained below.

The prediction of a seizure corresponds to the classification of all possible observations into the two disjoint subsets: (i) ‘a seizure will occur’ or (ii) ‘no seizure will occur’, which leads to the classification of each data set into ‘preictal’ or ‘not preictal’, respectively. To quantify prediction performance, we use the notion of sensitivity and false-prediction rate (FPR). The sensitivity is the number of correct predictions in relation to the total number of predictions. Specificity is quantified by the FPR, given as the number of falsely predicted seizures per hour of interictal data. For a given FPR, the associated threshold values for the parameters specifying the dimension drops are calculated. Minimal durations of dimension drops were evaluated for up to half the prediction window length in increments of 1 min. Sensitivity is derived by applying these thresholds to the preictal dimension drops. The results are displayed as sensitivity/FPR curves. Lower threshold values give a higher probability of correct predictions at the expense of higher FPR. By proper adjustment of the threshold, one can trade off sensitivity for FPR. The calculation of sensitivity was based on three prediction windows of 10, 20 and 50 min duration, ending 5 s before the electrographic seizure onset. After a false prediction in the analysis of the interictal data sets, the alarm mechanism was deactivated for the duration of the respective alarm window of the preictal analysis.

Figure 3 gives an example with interictal (Fig. 3a and b) and preictal (Fig. 3c and d) data sets of one patient. A dimension drop directly precedes a seizure in Fig. 3d. However, the dimension drop parameters do not exceed the maximal interictal values in Fig. 3b. Hence, the drop is not predictive according to the above definition. The evaluation with allowed false alarms in the 10, 20 and 50 min alarm windows depends on the derived thresholds T and the minimal dimension drop durations.



View larger version (16K):
[in this window]
[in a new window]
 
Fig. 3 Examples of D2eff data from interictal (a, b) and preictal (c, d) data sets each of 60 min length from one patient. The mean interictal level Davg is shown by the dotted horizontal line. The dimension drop in d directly precedes the seizure onset (marked by vertical bold line). Maximal dimension drop lengths in this example are labelled with ti and tp, respectively. The duration tp exceeds ti, but the maximum interictal deflection exceeds the preictal one. Hence, the dimension drop is not predictive according to the definition. For the evaluation with allowed false-predictions, the 10, 20 and 50 min alarm windows in c and d are marked with vertical lines and labelled with arrows. Threshold values T1 and T2 resulting from given maximum FPR are denoted with horizontal lines. Alarms are given by downward crossings. For the threshold value T1 = 5.5 and for a small minimal dimension drop duration, alarms are given in c in the 10 and 20 min windows. No false alarms are raised in a and b and no alarm is given in d. For a higher FPR and for a minimal drop duration >= ti, the threshold value increases to T2 = 6.8. One false alarm is given in b. No alarms are given in a and c, since the dimension drops are too short. No alarm is given in d.

 
Random alert system
A minimum requirement for a useful prediction method is its superiority to a random alert system. Within a small time interval u a maximum FPR FPRmax can be expressed as the probability P = FPRmax·u to produce one false alarm. The probability P for exactly one false alarm within a time interval W = n·u, with an integer n, is hence:

P = 1 – (1 – FPRmaxu)W/u

If u is small compared with W, P can be approximated as:

P {approx} 1 – eFPRmaxW(2)

P describes the sensitivity of a random alert system. For a large window length W, P converges to 1, e.g. if FPRmax = 0.1/h and W = 50 h, Equation 2 yields P = 0.9933.


    Results
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
Predictive dimension drops directly preceding seizures
The results of the dimension drop analysis for interictal and preictal data sets of the hippocampal and neocortical groups according to the definition from Lehnertz et al. (2001)Go are given in Table 2. Mean values and medians of the maximum interictal dimension drop parameters were: ti,avg = 10.9 min, di,avg = 3.7, ti,med = 8 min, di,med = 3.6 for the hippocampal group, and ti,avg = 12.4 min, di,avg = 3.7, ti,med = 5.3 min, di,med = 3.8 for the neocortical group. Dimension drops directly preceded seizures in five out of 30 (17%) seizures of hippocampal origin, and in nine out of 58 (16%) seizures of neocortical origin. The mean time intervals tp,avg of all dimension drops directly preceding seizures were 0.4 and 1.7 min for the hippocampal and neocortical group, respectively. For only one dimension drop from the neocortical group, the parameters (tp = 8 min and dp = 3.8) exceeded the maximum values of the interictal dimension drops. Following the criteria of Lehnertz et al. (2001)Go, this was the only correct seizure prediction. No dimension drop from the hippocampal group was predictive.


View this table:
[in this window]
[in a new window]
 
Table 2 Results of the dimension drop analysis
 
Predictive dimension drops within preictal time windows
Hippocampal group
The mean values and medians of all interictal and preictal dimension drops with ti, tp >= 80 s were: ti,avg = 2.7 min, ti,med = 1.9 min, tp,avg = 2.9 min, tp,med = 1.9 min, and di,avg = 2.4, di,med = 2.4, dp,avg = 2.6, dp,med = 2.5. The means and medians differ due to the skewed distribution with many short drops compared with few long drops. There were no significant differences between the interictal and preictal data. The maximum duration of the individual dimension drops was 1504 s interictally and 1952 s preictally.

For seven given FPR between 0/h and 1/h based on thresholds derived from the interictal data, the sensitivities for each patient for the 10, 20 and 50 min windows are given in Table 3. The values of the averaged sensitivities Savg for all patients are displayed for the 10, 20 and 50 min alarm windows in Fig. 4 for optimized minimal durations of dimension drops. For FPRmax = 0/h the averaged sensitivities were 4.2, 9.2 and 14.2% for the 10, 20 and 50 min windows, respectively. For FPRmax = 0.1/h the averaged sensitivities were 8.3, 13.3 and 38.3% for the 10, 20 and 50 min windows, respectively. For increasing FPRmax, sensitivities rise up to 95% for a 50 min alarm window and FPR of 1/h.


View this table:
[in this window]
[in a new window]
 
Table 3 Detailed results with sensitivities and maximum FPR
 


View larger version (10K):
[in this window]
[in a new window]
 
Fig. 4 Averaged sensitivities (±2 SE) of the analysis of the data with hippocampal seizure origin with optimized minimal dimension drop durations for the maximum FPR 0/h, 0.05/h, 0.1/h, 0.25/h, 0.4/h, 0.6/h and 1/h for the 10 (top), 20 (middle) and 50 min (bottom) alarm windows. For comparison, the probability of the corresponding random alert system is given (solid line).

 
The sensitivities from the corresponding random alert systems according to Equation 2 are displayed in Fig. 4. Under most conditions, these are significantly lower than the sensitivities of the prediction algorithm.

Neocortical group
The mean values and medians of all interictal and preictal dimension drops with ti, tp >= 80 s were: ti,avg = 3.4 min, ti,med = 2.1 min, tp,avg = 3.4 min, tp,med = 2.1 min, and di,avg = 2.2, di,med = 2.0, dp,avg = 2.5, dp,med = 2.2. Again, there were no significant differences between the interictal and preictal data. The maximum duration of the individual dimension drops was 3136 s interictally and 3360 s preictally.

For seven given FPR between 0/h and 1/h based on thresholds derived from the interictal data, the sensitivities for each patient for the 10, 20 and 50 min windows are given in Table 3. The values of the averaged sensitivities Savg for all patients are displayed for the 10, 20 and 50 min alarm windows in Fig. 5 for optimized minimal dimension drop durations. For FPRmax = 0/h the averaged sensitivities were 10.4, 11.9 and 18.5% for the 10, 20 and 50 min windows, respectively. For FPRmax = 0.1/h the averaged sensitivities were 13.9, 18.5 and 33.5% for the 10, 20 and 50 min windows, respectively. For increasing FPRmax, sensitivities rise up to 84% for a 50 min alarm window and FPR of 1/h.



View larger version (10K):
[in this window]
[in a new window]
 
Fig. 5 Averaged sensitivities (±2 SE) of the analysis of the data with neocortical seizure origin with optimized minimal dimension drop durations for the maximum FPR 0/h, 0.05/h, 0.1/h, 0.25/h, 0.4/h, 0.6/h and 1/h for the 10 (top), 20 (middle) and 50 min (bottom) alarm windows. For comparison, the probability of the corresponding random alert system is plotted (solid line).

 
The sensitivities from the corresponding random alert systems according to Equation 2 are displayed in Fig. 5. These are significantly lower than the sensitivities of the prediction algorithm.

There was no consistent difference in the performance of seizure prediction between patients who became seizure-free after surgery and those who did not.


    Discussion
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
Importance of interictal data for the evaluation of seizure prediction algorithms
The successful identification of preictal periods by extracting features from EEG data critically depends on the comparison with the behaviour of the feature during interictal periods. Both specificity and sensitivity of a prediction method can be quantified, but only based on long-term EEG recordings comprising a sufficient number of preictal periods, ictal events and interictal data representing the natural variability, e.g. including the effects of circadian rhythms (Litt and Lehnertz, 2002Go; Litt and Echauz, 2002Go). In other words, whether an algorithm that detects preictal changes in the EEG is of clinical value depends on the number of false predictions for interictal data. To determine this relation quantitatively, our evaluation of a nonlinear method to predict epileptic seizures was based on a representative long-term EEG data set, comprising 50 min of preictal and 24 h of interictal periods.

Predictive dimension drops
Using an algorithm based on drops in the effective correlation dimension D2eff, Lehnertz and Elger (1998)Go reported that a reduced dimensional complexity of brain activity, as soon as it is of sufficient size and duration, can be regarded as a specific feature defining states that precede a seizure. Analysing data from the epileptogenic area, they reported seizure preceding predictive dimension drops in 67% of hippocampal and 29% of neocortical epilepsy (Lehnertz et al., 2001Go). Predictive dimension drops were defined as being more pronounced than during interictal periods. This is where the amount and representativity of interictal data come into play. Our analysis resulted in only one successful prediction out of 88 preictal periods. The natural explanation for this dramatic loss of performance is the greater and more representative variability of the dimension drops within interictal periods of longer duration (24 h) compared with the 30–50 min blocks in the former study.

Permitting false predictions
In their study, Lehnertz et al. (2001)Go considered only dimension drops that exceeded interictal ones and directly preceded the seizure. Our analysis suggests that these criteria are too stringent to be successfully applied to long-term data. We have thus loosened both restrictions in order to investigate whether dimension drops of sufficient size are indicative of an imminent seizure: (i) an acceptable FPR is allowed for; and (ii) the prediction is based on dimension drops occurring within certain time windows before the onset of the seizure. Regarding (i), a range of maximum FPR was specified and corresponding thresholds of the extracted features were determined based on the interictal data. With respect to (ii), dimension drops occurring at any time within windows of length 10–50 min before the seizure’s onset were considered.

Under these conditions, the prediction methods result in a sensitivity of 38% in hippocampal seizures and 33% in neocortical seizures if a FPR of 0.1/h is permitted for interictal data and a 50 min time window is considered preictally. The algorithm outperforms a random alert system significantly. This shows that the preictal EEG carries information about the forthcoming seizure, and that the extracted feature indeed captures this information to some degree. This is remarkable, as there is an ongoing debate with respect to the applicability of methods from nonlinear dynamics to biological data (Rapp et al., 1993Go; Jedynak et al., 1994Go; Kantz and Schreiber, 1997Go; Schreiber, 1999Go; Timmer et al., 2000Go).

Clinical applicability
Apart from the statistical superiority of a prediction algorithm to a random alert system, clinical applicability depends on a number of additional factors. To determine the sensitivity of a method, three steps have to be applied: (i) the choice of a maximum FPR; (ii) the derivation of a threshold based on representative long-term interictal data; and (iii) the determination of the sensitivity based on preictal data. The allowed FPR depends on clinical and technical requirements as well as on individual factors of the patient. In this study, we regarded a range of maximum FPR between 0/h and 1/h. Reasonable FPR should be at most on the order of the patient’s seizure frequency. On average, patients suffering from pharmacorefractory epilepsy have a seizure frequency of three seizures per month, corresponding to a rate of 0.0042 seizures per hour (Bauer and Burr, 2001Go), which may increase up to 0.15 seizures per hour if medication is discontinued (Haut et al., 2002Go). Applying the results for hippocampal prediction performance to such a patient, one out of three seizures would be predicted correctly within 1 month, while about 70 false predictions have to be accepted. This would mean that <2% of the predictions are correct, whereas more than 60% of the seizures would occur unpredicted. Used as a pure warning system, a prediction method of this quality would probably be ignored after a short time. If used as an automatic therapeutic device, most interventions would be obsolete and potentially harmful to the patient.

Conclusions
An analysis of 88 seizures from 21 patients with pharmacorefractoral focal epilepsy showed that dimension drops (Lehnertz and Elger, 1998Go; Lehnertz et al., 2001Go) are not sensitive indicators of upcoming seizures. Basing specificity on long-term interictal EEG recordings, only one out of 88 seizures could be predicted successfully. An analysis of dimension drops occurring within certain time windows preceding seizures showed that dimension drops predict seizures with a better performance than a random alert system. Considering clinical applicability, however, sensitivity and specificity of the method are not sufficient. A gain in specificity can only be achieved at the expense of sensitivity and vice versa.

Our analysis showed that dimension drops in the epileptic focus in interictal data can be observed to an extent comparable to preictal data. Lehnertz and Elger (1995)Go reported that drops in the effective correlation dimension method correctly lateralize the seizure onset zone based on an analysis of even interictal data alone. That is, at times far from seizure onset, dimension drops take place that typically occur in the focal area. The duration and amplitude of these interictal dimension drops have a wide overlap with preictal drops if sufficiently long interictal periods are considered. The limited performance of the dimension drops with regard to the preictal period may thus be related to the very fact that dimension drops occurring during interictal periods are a hallmark of the epileptogenic area, as has been shown by Lehnertz and Elger (1995)Go. Thus, the sensitivity of the method to detect changes during interictal periods may pose a fundamental limitation to its ability to predict seizures with sufficient specificity.


    Acknowledgements
 
We wish to thank Dr Klaus Lehnertz, Clinic of Epileptology (Bonn), for his support and discussions; in particular, for providing short reference data sets for validation of the algorithm.


    References
 Top
 Summary
 Introduction
 Material and methods
 Results
 Discussion
 References
 
Bauer J, Burr W. Course of chronic focal epilepsy resistant to anticonvulsant treatment. Seizure 2001; 10: 239–46.[CrossRef][Web of Science][Medline]

Buck D, Baker GA, Jacoby A, Smith DF, Chadwick DW. Patients’ experiences of injury as a result of epilepsy. Epilepsia 1997; 38: 439–44.[CrossRef][Web of Science][Medline]

Cockerell OC, Johnson AL, Sander JW, Hart YM, Goodridge DM, Shorvon SD. Mortality from epilepsy: results from a prospective population-based study. Lancet 1994; 344: 918–21.[CrossRef][Web of Science][Medline]

Grassberger P, Procaccia I. Characterization of strange attractors. Phys Rev Lett 1983a; 50: 346–9.[CrossRef]

Grassberger P, Procaccia I. Measuring the strangeness of strange attractors. Physica D 1983b; 9: 189–204.[CrossRef]

Haut SR, Swick C, Freeman K, Spencer S. Seizure clustering during epilepsy monitoring. Epilepsia 2002; 43: 711–5.[CrossRef][Web of Science][Medline]

Iasemidis LD, Sackellares JC, Zaveri HP, Williams WJ. Phase space topography and the Lyapunov exponent of electrocorticograms in partial seizures. Brain Topogr 1990; 2: 187–201.[Medline]

Iasemidis LD, Principe JC, Czaplewski JM, Gilmore RL, Roper SN, Sackellares JC. Spatiotemporal transition to epileptic seizures: a nonlinear dynamics analysis of scalp and intracranial EEG recordings. In: Lopes da Silva FH, Principe JC, Almeida LB, editors. Spatiotemporal models in biological and artificial systems. Amsterdam: IOS Press; 1997. p. 81–8.

Jedynak A, Bach M, Timmer J. Failure of dimension analysis in a simple five-dimensional system. Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics 1994; 50: 1770–80.[Medline]

Jerger KK, Netoff TI, Francis JT, Sauer T, Pecora L, Weinstein SL, et al. Early seizure detection. J Clin Neurophysiol 2001; 18: 259–68.[CrossRef][Web of Science][Medline]

Kantz H, Schreiber T. Nonlinear time series analysis. Cambridge: Cambridge University Press; 1997.

Lai YC, Osorio I, Harrison MA, Frei MG. Correlation-dimension and autocorrelation fluctuations in epileptic seizure dynamics. Phys Rev E 2002; 65: 031921.

Le Van Quyen M, Martinerie J, Baulac M, Varela F. Anticipating epileptic seizures in real time by a non-linear analysis of similarity between EEG recordings. Neuroreport 1999; 10: 2149–55.[Web of Science][Medline]

Le Van Quyen M, Martinerie J, Navarro V, Baulac AM, Varela FJ. Characterizing neurodynamic changes before seizures. J Clin Neurophysiol 2001a; 18: 191–208.[CrossRef][Web of Science][Medline]

Le Van Quyen M, Martinerie J, Navarro V, Boon P, D’Have M, Adam C, et al. Anticipation of epileptic seizures from standard EEG recordings. Lancet 2001b; 357: 183–8.[CrossRef][Web of Science][Medline]

Lehnertz K, Elger CE. Spatio-temporal dynamics of the primary epileptogenic area in temporal lobe epilepsy characterized by neuronal complexity loss. Electroencephalogr Clin Neurophysiol 1995; 95: 108–17.[CrossRef][Medline]

Lehnertz K, Elger CE. Can epileptic seizures be predicted? Evidence from nonlinear time series analysis of brain electrical activity. Phys Rev Lett 1998; 80: 5019–22.[CrossRef]

Lehnertz K, Andrzejak RG, Arnhold J, Kreuz T, Mormann F, Rieke C, et al. Nonlinear EEG analysis in epilepsy: its possible use for interictal focus localization, seizure anticipation, and prevention. J Clin Neurophysiol 2001; 18: 209–22.[CrossRef][Web of Science][Medline]

Litt B, Echauz J. Prediction of epileptic seizures. Lancet Neurol 2002; 1: 22–30.[CrossRef][Web of Science][Medline]

Litt B, Lehnertz K. Seizure prediction and the preseizure period. Curr Opin Neurol 2002; 15: 173–7.[CrossRef][Web of Science][Medline]

Litt B, Esteller R, Echauz J, D’Alessandro M, Shor R, Henry T, et al. Epileptic seizures may begin hours in advance of clinical onset: a report of five patients. Neuron 2001; 30: 51–64.[CrossRef][Web of Science][Medline]

Martinerie J, Adam C, Le Van Quyen M, Baulac M, Clemenceau S, Renault B, et al. Epileptic seizures can be anticipated by non-linear analysis. Nat Med 1998; 4: 1173–6.[CrossRef][Web of Science][Medline]

Moser HR, Weber B, Wieser HG, Meier PF. Electroencephalo grams in epilepsy: analysis and seizure prediction within the framework of Lyapunov theory. Physica D 1999; 130: 291–305.

Murray J. Coping with the uncertainty of uncontrolled epilepsy. Seizure 1993; 2: 167–78.[CrossRef][Web of Science][Medline]

Navarro V, Martinerie J, Le Van Quyen M, Clemenceau S, Adam C, Baulac M, et al. Seizure anticipation in human neocortical partial epilepsy. Brain 2002; 125: 640–55.[Abstract/Free Full Text]

Osorio I, Frei MG, Wilkinson SB. Real-time automated detection and quantitative analysis of seizures and short-term prediction of clinical onset. Epilepsia 1998; 39: 615–27.[CrossRef][Web of Science][Medline]

Osorio I, Frei MG, Giftakis J, Peters T, Ingram J, Turnbull M, et al. Performance reassessment of a real-time seizure-detection algorithm on long ECoG series. Epilepsia 2002; 43: 1522–35.[Medline]

Pijn JP, Van Neerven J, Noest A, Lopes da Silva FH. Chaos or noise in EEG signals; dependence on state and brain site. Electroencephalogr Clin Neurophysiol 1991; 79: 371–81.[CrossRef][Web of Science][Medline]

Pijn JP, Velis DN, van der Heyden MJ, DeGoede J, van Veelen CW, Lopes da Silva FH. Nonlinear dynamics of epileptic seizures on basis of intracranial EEG recordings. Brain Topogr 1997; 9: 249–70.[Web of Science][Medline]

Pritchard WS, Duke DW. Measuring chaos in the brain: a tutorial review of nonlinear dynamical EEG analysis. Int J Neurosci 1992; 67: 31–80.[Web of Science][Medline]

Pritchard WS, Duke DW, Krieble KK. Dimensional analysis of resting human EEG. II: Surrogate-data testing indicates nonlinearity but not low-dimensional chaos. Psychophysiology 1995; 32: 486–91.[CrossRef][Web of Science][Medline]

Rapp PE, Albano AM, Schmah TI, Farwell LA. Filtered noise can mimic low-dimensional chaotic attractors. Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics 1993; 47: 2289–97.[Medline]

Schiff SJ. Forecasting brain storms. Nat Med 1998; 4: 1117–8.[CrossRef][Web of Science][Medline]

Schreiber T. Interdisciplinary application of nonlinear time series methods. Phys Rep 1999; 308: 1–64.[CrossRef]

Schulze-Bonhage AH, Huppertz HJ, Comeau RM, Honegger JB, Spreer JM, Zentner JK. Visualization of subdural strip and grid electrodes using curvilinear reformatting of 3D MR imaging data sets. AJNR Am J Neuroradiol 2002; 23: 400–3.[Abstract/Free Full Text]

Stein AG, Eder HG, Blum DE, Drachev A, Fischer RS. An automated drug delivery system for focal epilepsy. Epilepsy Res 2000; 39: 103–14.[CrossRef][Web of Science][Medline]

Takens F. Detecting strange attractors in turbulence. In: Rand DA, Young LS, editors. Lecture notes in mathematics. Berlin: Springer Verlag; 1981. p. 366–81.

Theiler J. Spurious dimension from correlation algorithms applied to limited time-series data. Phys Rev A 1986; 34: 2427–32.[CrossRef][Medline]

Timmer J, Häussler S, Lauk M, Lücking CH. Pathological tremors: deterministic chaos or nonlinear stochastic oscillators? Chaos 2000; 10: 278–88.[Medline]

van der Heyden MJ, Velis DN, Hoekstra BP, Pijn JP, van Emde Boas W, van Veelen CW, et al. Non-linear analysis of intracranial human EEG in temporal lobe epilepsy. Clin Neurophysiol 1999; 110: 1726–40.[Medline]

Winterhalder M, Maiwald T, Voss HU, Aschenbrenner-Scheibe R, Timmer J, Schulze-Bonhage A. The seizure prediction characteristic: a general framework to assess and compare seizure prediction methods. Epilepsy Behav 2003; 4: 318–25.[CrossRef][Web of Science][Medline]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
J. Neurophysiol.Home page
S. Wong, A. B. Gardner, A. M. Krieger, and B. Litt
A Stochastic Framework for Evaluating Seizure Prediction Algorithms Using Hidden Markov Models
J Neurophysiol, March 1, 2007; 97(3): 2525 - 2532.
[Abstract] [Full Text] [PDF]


Home page
BrainHome page
F. Mormann, R. G. Andrzejak, C. E. Elger, and K. Lehnertz
Seizure prediction: the long and winding road
Brain, February 1, 2007; 130(2): 314 - 333.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
126/12/2616    most recent
awg265v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (30)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Aschenbrenner-Scheibe, R.
Right arrow Articles by Schulze-Bonhage, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Aschenbrenner-Scheibe, R.
Right arrow Articles by Schulze-Bonhage, A.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?