01876nas a2200217 4500008004100000245011000041210006900151260001200220300001600232490000700248520116000255100001201415700001901427700001501446700001601461700001601477700001501493700001901508700001601527856011501543 2023 eng d00aUnexpected sound omissions are signaled in human posterior superior temporal gyrus: an intracranial study0 aUnexpected sound omissions are signaled in human posterior super c07/2023 a8837–88480 v333 aContext modulates sensory neural activations enhancing perceptual and behavioral performance and reducing prediction errors. However, the mechanism of when and where these high-level expectations act on sensory processing is unclear. Here, we isolate the effect of expectation absent of any auditory evoked activity by assessing the response to omitted expected sounds. Electrocorticographic signals were recorded directly from subdural electrode grids placed over the superior temporal gyrus (STG). Subjects listened to a predictable sequence of syllables, with some infrequently omitted. We found high-frequency band activity (HFA, 70-170 Hz) in response to omissions, which overlapped with a posterior subset of auditory-active electrodes in STG. Heard syllables could be distinguishable reliably from STG, but not the identity of the omitted stimulus. Both omission- and target-detection responses were also observed in the prefrontal cortex. We propose that the posterior STG is central for implementing predictions in the auditory environment. HFA omission responses in this region appear to index mismatch-signaling or salience detection processes.1 aCho, H.1 aFonken, Y., M.1 aAdamek, M.1 aJimenez, R.1 aLin, J., J.1 aSchalk, G.1 aKnight, R., T.1 aBrunner, P. uhttps://neurotechcenter.org/publications/2023/unexpected-sound-omissions-are-signaled-human-posterior-superior02317nas a2200253 4500008004100000022001400041245011300055210006900168260001200237520148500249100001301734700001401747700001901761700001801780700002101798700001801819700001801837700001701855700001801872700001901890700001901909700001601928856011901944 2022 eng d a1741-255200aAutomated intraoperative central sulcus localization and somatotopic mapping using median nerve stimulation.0 aAutomated intraoperative central sulcus localization and somatot c07/20223 a

OBJECTIVE: Accurate identification of functional cortical regions is essential in neurological resection. The central sulcus (CS) is an important landmark that delineates functional cortical regions. Median nerve stimulation (MNS) is a standard procedure to identify the position of the CS intraoperatively. In this paper, we introduce an automated procedure that uses MNS to rapidly localize the CS and create functional somatotopic maps.

APPROACH: We recorded electrocorticographic signals from 13 patients who underwent MNS in the course of an awake craniotomy. We analyzed these signals to develop an automated procedure that determines the location of the CS and that also produces functional somatotopic maps.

MAIN RESULTS: The comparison between our automated method and visual inspection performed by the neurosurgeon shows that our procedure has a high sensitivity (89%) in identifying the CS. Further, we found substantial concordance between the functional somatotopic maps generated by our method and passive functional mapping (92% sensitivity).

SIGNIFICANCE: Our automated MNS-based method can rapidly localize the CS and create functional somatotopic maps without imposing additional burden on the clinical procedure. With additional development and validation, our method may lead to a diagnostic tool that guides neurosurgeon and reduces postoperative morbidity in patients undergoing resective brain surgery.

1 aXie, Tao1 aWu, Zehan1 aSchalk, Gerwin1 aTong, Yusheng1 aVato, Alessandro1 aRaviv, Nataly1 aGuo, Qinglong1 aYe, Huanpeng1 aSheng, Xinjun1 aZhu, Xiangyang1 aBrunner, Peter1 aChen, Liang uhttps://neurotechcenter.org/publications/2022/automated-intraoperative-central-sulcus-localization-and-somatotopic02741nas a2200205 4500008004100000022001400041245008300055210006900138260001200207300001100219490000700230520205000237100002702287700002502314700001902339700001702358700001902375700002302394856011802417 2022 eng d a1662-516100aDynamics of Oddball Sound Processing: Trial-by-Trial Modeling of ECoG Signals.0 aDynamics of Oddball Sound Processing TrialbyTrial Modeling of EC c02/2022 a7946540 v153 a

Recent computational models of perception conceptualize auditory oddball responses as signatures of a (Bayesian) learning process, in line with the influential view of the mismatch negativity (MMN) as a prediction error signal. Novel MMN experimental paradigms have put an emphasis on neurophysiological effects of manipulating regularity and predictability in sound sequences. This raises the question of the contextual adaptation of the learning process itself, which on the computational side speaks to the mechanisms of gain-modulated (or precision-weighted) prediction error. In this study using electrocorticographic (ECoG) signals, we manipulated the predictability of oddball sound sequences with two objectives: (i) Uncovering the computational process underlying trial-by-trial variations of the cortical responses. The fluctuations between trials, generally ignored by approaches based on averaged evoked responses, should reflect the learning involved. We used a general linear model (GLM) and Bayesian Model Reduction (BMR) to assess the respective contributions of experimental manipulations and learning mechanisms under probabilistic assumptions. (ii) To validate and expand on previous findings regarding the effect of changes in predictability using simultaneous EEG-MEG recordings. Our trial-by-trial analysis revealed only a few stimulus-responsive sensors but the measured effects appear to be consistent over subjects in both time and space. In time, they occur at the typical latency of the MMN (between 100 and 250 ms post-stimulus). In space, we found a dissociation between time-independent effects in more anterior temporal locations and time-dependent (learning) effects in more posterior locations. However, we could not observe any clear and reliable effect of our manipulation of predictability modulation onto the above learning process. Overall, these findings clearly demonstrate the potential of trial-to-trial modeling to unravel perceptual learning processes and their neurophysiological counterparts.

1 aLecaignard, Françoise1 aBertrand, Raphaëlle1 aBrunner, Peter1 aCaclin, Anne1 aSchalk, Gerwin1 aMattout, Jérémie uhttps://neurotechcenter.org/publications/2022/dynamics-oddball-sound-processing-trial-trial-modeling-ecog-signals01952nas a2200337 4500008004100000022001400041245006800055210006600123300001800189490000700207520101700214653002001231653001401251653000901265653002501274653000901299653001001308653001901318653000901337653001101346653001001357100002901367700002101396700002001417700001901437700002201456700002401478700001901502700002101521856007201542 2022 eng d a0960-982200aA neural population selective for song in human auditory cortex0 aneural population selective for song in human auditory cortex a1470-1484.e120 v323 aSummary How is music represented in the brain? While neuroimaging has revealed some spatial segregation between responses to music versus other sounds, little is known about the neural code for music itself. To address this question, we developed a method to infer canonical response components of human auditory cortex using intracranial responses to natural sounds, and further used the superior coverage of fMRI to map their spatial distribution. The inferred components replicated many prior findings, including distinct neural selectivity for speech and music, but also revealed a novel component that responded nearly exclusively to music with singing. Song selectivity was not explainable by standard acoustic features, was located near speech- and music-selective responses, and was also evident in individual electrodes. These results suggest that representations of music are fractionated into subpopulations selective for different types of music, one of which is specialized for the analysis of song.10aAuditory Cortex10acomponent10aECoG10aElectrocorticography10afMRI10amusic10anatural sounds10asong10aSpeech10avoice1 aNorman-Haignere, Sam, V.1 aFeather, Jenelle1 aBoebinger, Dana1 aBrunner, Peter1 aRitaccio, Anthony1 aMcDermott, Josh, H.1 aSchalk, Gerwin1 aKanwisher, Nancy uhttps://www.sciencedirect.com/science/article/pii/S096098222200131202268nas a2200337 4500008004100000022001400041245011100055210006900166260001200235300001100247490000800258520124200266653002501508653001001533653000901543653001701552653002001569653001801589653002601607653002501633653001101658653001101669653000901680653001601689100002301705700003201728700001901760700001901779700001901798856011301817 2021 eng d a1095-957200aModulation in cortical excitability disrupts information transfer in perceptual-level stimulus processing.0 aModulation in cortical excitability disrupts information transfe c11/2021 a1184980 v2433 a

Despite significant interest in the neural underpinnings of behavioral variability, little light has been shed on the cortical mechanism underlying the failure to respond to perceptual-level stimuli. We hypothesized that cortical activity resulting from perceptual-level stimuli is sensitive to the moment-to-moment fluctuations in cortical excitability, and thus may not suffice to produce a behavioral response. We tested this hypothesis using electrocorticographic recordings to follow the propagation of cortical activity in six human subjects that responded to perceptual-level auditory stimuli. Here we show that for presentations that did not result in a behavioral response, the likelihood of cortical activity decreased from auditory cortex to motor cortex, and was related to reduced local cortical excitability. Cortical excitability was quantified using instantaneous voltage during a short window prior to cortical activity onset. Therefore, when humans are presented with an auditory stimulus close to perceptual-level threshold, moment-by-moment fluctuations in cortical excitability determine whether cortical responses to sensory stimulation successfully connect auditory input to a resultant behavioral response.

10aAcoustic Stimulation10aAdult10aAged10aAlpha Rhythm10aAuditory Cortex10aBrain Mapping10aCortical Excitability10aElectrocorticography10aFemale10aHumans10aMale10aMiddle Aged1 aMoheimanian, Ladan1 aParaskevopoulou, Sivylla, E1 aAdamek, Markus1 aSchalk, Gerwin1 aBrunner, Peter uhttps://neurotechcenter.org/publications/2021/modulation-cortical-excitability-disrupts-information-transfer02749nas a2200373 4500008004100000022001400041245011800055210006900173260001200242300001100254490000800265520163200273653001001905653001501915653001701930653002001947653001501967653002501982653001102007653001702018653001102035653000902046653001602055653001402071653002802085653001802113653001602131100003202147700002102179700001902200700001902219700001902238856011802257 2021 eng d a1095-957200aWithin-subject reaction time variability: Role of cortical networks and underlying neurophysiological mechanisms.0 aWithinsubject reaction time variability Role of cortical network c08/2021 a1181270 v2373 a

Variations in reaction time are a ubiquitous characteristic of human behavior. Extensively documented, they have been successfully modeled using parameters of the subject or the task, but the neural basis of behavioral reaction time that varies within the same subject and the same task has been minimally studied. In this paper, we investigate behavioral reaction time variance using 28 datasets of direct cortical recordings in humans who engaged in four different types of simple sensory-motor reaction time tasks. Using a previously described technique that can identify the onset of population-level cortical activity and a novel functional connectivity algorithm described herein, we show that the cumulative latency difference of population-level neural activity across the task-related cortical network can explain up to 41% of the trial-by-trial variance in reaction time. Furthermore, we show that reaction time variance may primarily be due to the latencies in specific brain regions and demonstrate that behavioral latency variance is accumulated across the whole task-related cortical network. Our results suggest that population-level neural activity monotonically increases prior to movement execution, and that trial-by-trial changes in that increase are, in part, accounted for by inhibitory activity indexed by low-frequency oscillations. This pre-movement neural activity explains 19% of the measured variance in neural latencies in our data. Thus, our study provides a mechanistic explanation for a sizable fraction of behavioral reaction time when the subject's task is the same from trial to trial.

10aAdult10aAlgorithms10aAlpha Rhythm10aCerebral Cortex10aConnectome10aElectrocorticography10aFemale10aGamma Rhythm10aHumans10aMale10aMiddle Aged10aNerve Net10aPsychomotor Performance10aReaction Time10aYoung Adult1 aParaskevopoulou, Sivylla, E1 aCoon, William, G1 aBrunner, Peter1 aMiller, Kai, J1 aSchalk, Gerwin uhttps://neurotechcenter.org/publications/2021/within-subject-reaction-time-variability-role-cortical-networks-and03173nas a2200493 4500008004100000022001400041245012000055210006900175260001200244300001200256490000800268520172300276653001801999653002002017653001502037653001102052653002202063653001102085653001102096653001402107653001302121653000902134653001602143653003102159653001402190653002602204653001302230653001802243653001602261100001802277700002302295700002102318700002302339700002602362700002402388700001802412700001902430700001402449700002202463700002202485700002602507700003102533856011502564 2020 eng d a1573-737300aPotential differences between monolingual and bilingual patients in approach and outcome after awake brain surgery.0 aPotential differences between monolingual and bilingual patients c07/2020 a587-5980 v1483 a

INTRODUCTION: 20.8% of the United States population and 67% of the European population speak two or more languages. Intraoperative different languages, mapping, and localization are crucial. This investigation aims to address three questions between BL and ML patients: (1) Are there differences in complications (i.e. seizures) and DECS techniques during intra-operative brain mapping? (2) Is EOR different? and (3) Are there differences in the recovery pattern post-surgery?

METHODS: Data from 56 patients that underwent left-sided awake craniotomy for tumors infiltrating possible dominant hemisphere language areas from September 2016 to June 2019 were identified and analyzed in this study; 14 BL and 42 ML control patients. Patient demographics, education level, and the age of language acquisition were documented and evaluated. fMRI was performed on all participants.

RESULTS: 0 (0%) BL and 3 (7%) ML experienced intraoperative seizures (P = 0.73). BL patients received a higher direct DECS current in comparison to the ML patients (average = 4.7, 3.8, respectively, P = 0.03). The extent of resection was higher in ML patients in comparison to the BL patients (80.9 vs. 64.8, respectively, P = 0.04). The post-operative KPS scores were higher in BL patients in comparison to ML patients (84.3, 77.4, respectively, P = 0.03). BL showed lower drop in post-operative KPS in comparison to ML patients (- 4.3, - 8.7, respectively, P = 0.03).

CONCLUSION: We show that BL patients have a lower incidence of intra-operative seizures, lower EOR, higher post-operative KPS and tolerate higher DECS current, in comparison to ML patients.

10aBrain Mapping10aBrain Neoplasms10aCraniotomy10aFemale10aFollow-Up Studies10aGlioma10aHumans10aIncidence10aLanguage10aMale10aMiddle Aged10aMonitoring, Intraoperative10aPrognosis10aRetrospective Studies10aSeizures10aUnited States10aWakefulness1 aReFaey, Karim1 aTripathi, Shashwat1 aBhargav, Adip, G1 aGrewal, Sanjeet, S1 aMiddlebrooks, Erik, H1 aSabsevitz, David, S1 aJentoft, Mark1 aBrunner, Peter1 aWu, Adela1 aTatum, William, O1 aRitaccio, Anthony1 aChaichana, Kaisorn, L1 aQuinones-Hinojosa, Alfredo uhttps://neurotechcenter.org/publications/2020/potential-differences-between-monolingual-and-bilingual-patients02978nas a2200313 4500008004100000022001400041245013700055210006900192260001200261300001100273490000700284520198000291653001002271653001802281653002502299653002602324653002702350653001102377653003102388100001602419700001702435700001502452700001902467700001402486700001902500700001602519700001902535856011002554 2019 eng d a1741-255200aiEEGview: an open-source multifunction GUI-based Matlab toolbox for localization and visualization of human intracranial electrodes.0 aiEEGview an opensource multifunction GUIbased Matlab toolbox for c12/2019 a0160160 v173 a

OBJECTIVE: The precise localization of intracranial electrodes is a fundamental step relevant to the analysis of intracranial electroencephalography (iEEG) recordings in various fields. With the increasing development of iEEG studies in human neuroscience, higher requirements have been posed on the localization process, resulting in urgent demand for more integrated, easy-operation and versatile tools for electrode localization and visualization. With the aim of addressing this need, we develop an easy-to-use and multifunction toolbox called iEEGview, which can be used for the localization and visualization of human intracranial electrodes.

APPROACH: iEEGview is written in Matlab scripts and implemented with a GUI. From the GUI, by taking only pre-implant MRI and post-implant CT images as input, users can directly run the full localization pipeline including brain segmentation, image co-registration, electrode reconstruction, anatomical information identification, activation map generation and electrode projection from native brain space into common brain space for group analysis. Additionally, iEEGview implements methods for brain shift correction, visual location inspection on MRI slices and computation of certainty index in anatomical label assignment.

MAIN RESULTS: All the introduced functions of iEEGview work reliably and successfully, and are tested by images from 28 human subjects implanted with depth and/or subdural electrodes.

SIGNIFICANCE: iEEGview is the first public Matlab GUI-based software for intracranial electrode localization and visualization that holds integrated capabilities together within one pipeline. iEEGview promotes convenience and efficiency for the localization process, provides rich localization information for further analysis and offers solutions for addressing raised technical challenges. Therefore, it can serve as a useful tool in facilitating iEEG studies.

10aBrain10aBrain Mapping10aElectrocorticography10aElectrodes, Implanted10aElectroencephalography10aHumans10aMagnetic Resonance Imaging1 aLi, Guangye1 aJiang, Shize1 aChen, Chen1 aBrunner, Peter1 aWu, Zehan1 aSchalk, Gerwin1 aChen, Liang1 aZhang, Dingguo uhttps://neurotechcenter.org/publications/2019/ieegview-open-source-multifunction-gui-based-matlab-toolbox02512nas a2200289 4500008004100000022001400041245008600055210006900141300001200210490000800222520158400230653001701814653003901831653002701870653002501897100002701922700001901949700002401968700002101992700002102013700002402034700002502058700002302083700002602106700001902132856007102151 2019 eng d a0165-027000aA quantitative method for evaluating cortical responses to electrical stimulation0 aquantitative method for evaluating cortical responses to electri a67 - 750 v3113 aBackground Electrical stimulation of the cortex using subdurally implanted electrodes can causally reveal structural connectivity by eliciting cortico-cortical evoked potentials (CCEPs). While many studies have demonstrated the potential value of CCEPs, the methods to evaluate them were often relatively subjective, did not consider potential artifacts, and did not lend themselves to systematic scientific investigations. New method We developed an automated and quantitative method called SIGNI (Stimulation-Induced Gamma-based Network Identification) to evaluate cortical population-level responses to electrical stimulation that minimizes the impact of electrical artifacts. We applied SIGNI to electrocorticographic (ECoG) data from eight human subjects who were implanted with a total of 978 subdural electrodes. Across the eight subjects, we delivered 92 trains of approximately 200 discrete electrical stimuli each (amplitude 4–15 mA) to a total of 64 electrode pairs. Results We verified SIGNI's efficacy by demonstrating a relationship between the magnitude of evoked cortical activity and stimulation amplitude, as well as between the latency of evoked cortical activity and the distance from the stimulated locations. Conclusions SIGNI reveals the timing and amplitude of cortical responses to electrical stimulation as well as the structural connectivity supporting these responses. With these properties, it enables exploration of new and important questions about the neurophysiology of cortical communication and may also be useful for pre-surgical planning.10aConnectivity10aCortico-cortical evoked potentials10aElectrical stimulation10aElectrocorticography1 aCrowther, Lawrence, J.1 aBrunner, Peter1 aKapeller, Christoph1 aGuger, Christoph1 aKamada, Kyousuke1 aBunch, Marjorie, E.1 aFrawley, Bridget, K.1 aLynch, Timothy, M.1 aRitaccio, Anthony, L.1 aSchalk, Gerwin uhttp://www.sciencedirect.com/science/article/pii/S016502701830279600294nas a2200109 4500008004100000245001700041210001700058300000800075100001900083700001900102856006300121 2018 eng d00aBCI Software0 aBCI Software a3231 aBrunner, Peter1 aSchalk, Gerwin uhttps://neurotechcenter.org/publications/2018/bci-software00750nas a2200181 4500008004100000245016600041210006900207260002700276100001800303700001400321700001500335700001900350700001900369700002000388700002000408700002100428856011900449 2018 eng d00aCreating an eyes-closed binary SSVEP-based brain-computer interface (BCI) for the bedside: A comparison of foveal centered and off-centered stimulus presentation0 aCreating an eyesclosed binary SSVEPbased braincomputer interface aSan Diego, CAc11/20181 aVaughan, T.M.1 aAslam, M.1 aZoltan, B.1 aBrunner, Peter1 aNorton, J., J.1 aCarmack, C., S.1 aZeitlin, D., J.1 aWolpaw, Jonathan uhttps://neurotechcenter.org/publications/2018/creating-eyes-closed-binary-ssvep-based-brain-computer-interface-bci00739nas a2200181 4500008004100000245016600041210006900207260001200276100002000288700001400308700001500322700001900337700001900356700002000375700002000395700002100415856012100436 2018 eng d00aCreating an eyes-closed binary SSVEP-based brain-computer interface (BCI) for the bedside: A comparison of foveal centered and off-centered stimulus presentation0 aCreating an eyesclosed binary SSVEPbased braincomputer interface c11/20181 aVaughan, T., M.1 aAslam, M.1 aZoltan, B.1 aBrunner, Peter1 aNorton, J., J.1 aCarmack, C., S.1 aZeitlin, D., J.1 aWolpaw, Jonathan uhttps://neurotechcenter.org/publications/2018/creating-eyes-closed-binary-ssvep-based-brain-computer-interface-bci-001703nas a2200241 4500008004100000022002700041245009200068210006900160260001200229300001000241490000700251520086400258653001801122653003801140653003501178653002501213653002801238653002601266100001601292700001901308700001401327856012001341 2018 eng d a0736-0258/18/3502-008600aElectrical Stimulation Mapping of the Brain: Basic Principles and Emerging Alternatives0 aElectrical Stimulation Mapping of the Brain Basic Principles and c03/2018 a86-970 v353 aThe application of electrical stimulation mapping (ESM) of the brain for clinical use is approximating a century. Despite this long-standing history, the value of ESM for guiding surgical resections and sparing eloquent cortex is documented largely by small retrospective studies, and ESM protocols are largely inherited and lack standardization. Although models are imperfect and mechanisms are complex, the probabilistic causality of ESM has guaranteed its perpetuation into the 21st century. At present, electrical stimulation of cortical tissue is being revisited for network connectivity. In addition, noninvasive and passive mapping techniques are rapidly evolving to complement and potentially replace ESM in specific clinical situations. Lesional and epilepsy neurosurgery cases now offer different opportunities for multimodal functional assessments.10aBrain Mapping10aCorticocortical-evoked potentials10aelectrical stimulation mapping10aElectrocorticography10aFunctional localization10aPassive gamma mapping1 aRitaccio, A1 aBrunner, Peter1 aSchalk, G uhttps://journals.lww.com/clinicalneurophys/Abstract/2018/03000/Electrical_Stimulation_Mapping_of_the_Brain__.2.aspx00570nas a2200133 4500008004100000245012200041210006900163100001500232700001900247700002000266700001600286700001500302856011900317 2018 eng d00aInstantaneous voltage of electroencephalographic oscillatory activity: An alternative to power and phase measurements0 aInstantaneous voltage of electroencephalographic oscillatory act1 aAdamek, M.1 aBrunner, Peter1 aMoheimanian, L.1 aScherer, R.1 aSchalk, G. uhttps://neurotechcenter.org/publications/2018/instantaneous-voltage-electroencephalographic-oscillatory-activity-000607nas a2200145 4500008004100000245012200041210006900163260002700232100001500259700001900274700002000293700001600313700001500329856011700344 2018 eng d00aInstantaneous voltage of electroencephalographic oscillatory activity: An alternative to power and phase measurements0 aInstantaneous voltage of electroencephalographic oscillatory act aSan Diego, CAc11/20181 aAdamek, M.1 aBrunner, Peter1 aMoheimanian, L.1 aScherer, R.1 aSchalk, G. uhttps://neurotechcenter.org/publications/2018/instantaneous-voltage-electroencephalographic-oscillatory-activity00831nas a2200277 4500008004100000022001400041245009500055210006900150300001600219490000800235653000900243653002500252653002300277653001700300653002300317100001600340700001500356700001400371700001900385700001400404700001400418700001600432700001900448700001500467856007100482 2018 eng d a1388-245700aPassive functional mapping of receptive language areas using electrocorticographic signals0 aPassive functional mapping of receptive language areas using ele a2517 - 25240 v12910aECoG10aElectrocorticography10afunctional mapping10aIntracranial10aReceptive language1 aSwift, J.R.1 aCoon, W.G.1 aGuger, C.1 aBrunner, Peter1 aBunch, M.1 aLynch, T.1 aFrawley, B.1 aRitaccio, A.L.1 aSchalk, G. uhttp://www.sciencedirect.com/science/article/pii/S138824571831228800559nas a2200133 4500008004100000245007600041210006900117260002900186100002700215700001900242700002600261700001900287856011900306 2018 eng d00aRapid Identification of Cortical Connectivity During Functional Mapping0 aRapid Identification of Cortical Connectivity During Functional  aNew Orleans, LAc12/20181 aCrowther, Lawrence, J.1 aBrunner, Peter1 aRitaccio, Anthony, L.1 aSchalk, Gerwin uhttps://neurotechcenter.org/publications/2018/rapid-identification-cortical-connectivity-during-functional-mapping02510nas a2200289 4500008004100000022001400041245011800055210006900173260000800242520159500250100002501845700002401870700001701894700002501911700002301936700002101959700002501980700002402005700001902029700001902048700001802067700001902085700002202104700002302126700002302149856004802172 2017 eng d a1091-649000aSpatiotemporal dynamics of word retrieval in speech production revealed by cortical high-frequency band activity.0 aSpatiotemporal dynamics of word retrieval in speech production r cMay3 aWord retrieval is core to language production and relies on complementary processes: the rapid activation of lexical and conceptual representations and word selection, which chooses the correct word among semantically related competitors. Lexical and conceptual activation is measured by semantic priming. In contrast, word selection is indexed by semantic interference and is hampered in semantically homogeneous (HOM) contexts. We examined the spatiotemporal dynamics of these complementary processes in a picture naming task with blocks of semantically heterogeneous (HET) or HOM stimuli. We used electrocorticography data obtained from frontal and temporal cortices, permitting detailed spatiotemporal analysis of word retrieval processes. A semantic interference effect was observed with naming latencies longer in HOM versus HET blocks. Cortical response strength as indexed by high-frequency band (HFB) activity (70-150 Hz) amplitude revealed effects linked to lexical-semantic activation and word selection observed in widespread regions of the cortical mantle. Depending on the subsecond timing and cortical region, HFB indexed semantic interference (i.e., more activity in HOM than HET blocks) or semantic priming effects (i.e., more activity in HET than HOM blocks). These effects overlapped in time and space in the left posterior inferior temporal gyrus and the left prefrontal cortex. The data do not support a modular view of word retrieval in speech production but rather support substantial overlap of lexical-semantic activation and word selection mechanisms in the brain.1 aRiès, Stephanie, K.1 aDhillon, Rummit, K.1 aClarke, Alex1 aKing-Stephens, David1 aLaxer, Kenneth, D.1 aWeber, Peter, B.1 aKuperman, Rachel, A.1 aAuguste, Kurtis, I.1 aBrunner, Peter1 aSchalk, Gerwin1 aLin, Jack, J.1 aParvizi, Josef1 aCrone, Nathan, E.1 aDronkers, Nina, F.1 aKnight, Robert, T. uhttp://www.ncbi.nlm.nih.gov/pubmed/2853340603468nas a2200265 4500008004100000022001400041245013200055210006900187260000800256300001400264490000800278520267200286100001902958700001702977700001902994700001503013700001803028700001903046700001703065700002003082700001903102700001403121700001903135856004803154 2016 eng d a1095-957200aAlpha power indexes task-related networks on large and small scales: A multimodal ECoG study in humans and a non-human primate.0 aAlpha power indexes taskrelated networks on large and small scal cJul a122–1310 v1343 aPerforming different tasks, such as generating motor movements or processing sensory input, requires the recruitment of specific networks of neuronal populations. Previous studies suggested that power variations in the alpha band (8-12Hz) may implement such recruitment of task-specific populations by increasing cortical excitability in task-related areas while inhibiting population-level cortical activity in task-unrelated areas (Klimesch et al., 2007; Jensen and Mazaheri, 2010). However, the precise temporal and spatial relationships between the modulatory function implemented by alpha oscillations and population-level cortical activity remained undefined. Furthermore, while several studies suggested that alpha power indexes task-related populations across large and spatially separated cortical areas, it was largely unclear whether alpha power also differentially indexes smaller networks of task-related neuronal populations. Here we addressed these questions by investigating the temporal and spatial relationships of electrocorticographic (ECoG) power modulations in the alpha band and in the broadband gamma range (70-170Hz, indexing population-level activity) during auditory and motor tasks in five human subjects and one macaque monkey. In line with previous research, our results confirm that broadband gamma power accurately tracks task-related behavior and that alpha power decreases in task-related areas. More importantly, they demonstrate that alpha power suppression lags population-level activity in auditory areas during the auditory task, but precedes it in motor areas during the motor task. This suppression of alpha power in task-related areas was accompanied by an increase in areas not related to the task. In addition, we show for the first time that these differential modulations of alpha power could be observed not only across widely distributed systems (e.g., motor vs. auditory system), but also within the auditory system. Specifically, alpha power was suppressed in the locations within the auditory system that most robustly responded to particular sound stimuli. Altogether, our results provide experimental evidence for a mechanism that preferentially recruits task-related neuronal populations by increasing cortical excitability in task-related cortical areas and decreasing cortical excitability in task-unrelated areas. This mechanism is implemented by variations in alpha power and is common to humans and the non-human primate under study. These results contribute to an increasingly refined understanding of the mechanisms underlying the selection of the specific neuronal populations required for task execution.1 ade Pesters, A.1 aCoon, W., G.1 aBrunner, Peter1 aGunduz, A.1 aRitaccio, A L1 aBrunet, N., M.1 ade Weerd, P.1 aRoberts, M., J.1 aOostenveld, R.1 aFries, P.1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2705796001925nas a2200265 4500008004100000245010300041210006900144260000800213300001100221490000600232520106300238653000801301653003001309653000901339653002501348653002501373100002001398700001901418700001801437700002401455700002601479700001901505700001901524856011601543 2016 eng d00aDifferential roles of high gamma and local motor potentials for movement preparation and execution0 aDifferential roles of high gamma and local motor potentials for  cMay a88-1020 v33 aDetermining a person’s intent, such as the planned direction of their movement, directly from their cortical activity could support important applications such as brain-computer interfaces (BCIs). Continuing development of improved BCI systems requires a better understanding of how the brain prepares for and executes movements. To contribute to this understanding, we recorded surface cortical potentials (electrocorticographic signals; ECoG) in 11 human subjects performing a delayed center-out task to establish the differential role of high gamma activity (HGA) and the local motor potential (LMP) as a function of time and anatomical area during movement preparation and execution. High gamma modulations mostly confirm previous findings of sensorimotor cortex involvement, whereas modulations in LMPs are observed in prefrontal cortices. These modulations include directional information during movement planning as well as execution. Our results suggest that sampling signals from these widely distributed cortical areas improves decoding accuracy.10aBCI10abrain-computer interfaces10aECoG10aElectrocorticography10asensorimotor systems1 aGunduz, Aysegul1 aBrunner, Peter1 aSharma, Mohit1 aLeuthardt, Eric, C.1 aRitaccio, Anthony, L.1 aPesaran, Bijan1 aSchalk, Gerwin uhttps://neurotechcenter.org/publications/2016/differential-roles-high-gamma-and-local-motor-potentials-movement02053nas a2200217 4500008004100000245010300041210006900144260000800213300001200221490000600233520138300239100002301622700002401645700001901669700001701688700002201705700002301727700001801750700001901768856004801787 2016 eng d00aIntraoperative mapping of expressive language cortex using passive real-time electrocorticography.0 aIntraoperative mapping of expressive language cortex using passi cMar a46–510 v53 aIn this case report, we investigated the utility and practicality of passive intraoperative functional mapping of expressive language cortex using high-resolution electrocorticography (ECoG). The patient presented here experienced new-onset seizures caused by a medium-grade tumor in very close proximity to expressive language regions. In preparation of tumor resection, the patient underwent multiple functional language mapping procedures. We examined the relationship of results obtained with intraoperative high-resolution ECoG, extraoperative ECoG utilizing a conventional subdural grid, extraoperative electrical cortical stimulation (ECS) mapping, and functional magnetic resonance imaging (fMRI). Our results demonstrate that intraoperative mapping using high-resolution ECoG is feasible and, within minutes, produces results that are qualitatively concordant to those achieved by extraoperative mapping modalities. They also suggest that functional language mapping of expressive language areas with ECoG may prove useful in many intraoperative conditions given its time efficiency and safety. Finally, they demonstrate that integration of results from multiple functional mapping techniques, both intraoperative and extraoperative, may serve to improve the confidence in or precision of functional localization when pathology encroaches upon eloquent language cortex.1 aTaplin, AmiLyn, M.1 ade Pesters, Adriana1 aBrunner, Peter1 aHermes, Dora1 aDalfino, John, C.1 aAdamo, Matthew, A.1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2740880202058nas a2200217 4500008004100000022001400041245006200055210006100117260000800178300001800186490000800204520143200212100002301644700002101667700001901688700002201707700002301729700001901752700002101771856004801792 2016 eng d a1091-649000aNeural correlate of the construction of sentence meaning.0 aNeural correlate of the construction of sentence meaning cOct aE6256–E62620 v1133 aThe neural processes that underlie your ability to read and understand this sentence are unknown. Sentence comprehension occurs very rapidly, and can only be understood at a mechanistic level by discovering the precise sequence of underlying computational and neural events. However, we have no continuous and online neural measure of sentence processing with high spatial and temporal resolution. Here we report just such a measure: intracranial recordings from the surface of the human brain show that neural activity, indexed by $\gamma$-power, increases monotonically over the course of a sentence as people read it. This steady increase in activity is absent when people read and remember nonword-lists, despite the higher cognitive demand entailed, ruling out accounts in terms of generic attention, working memory, and cognitive load. Response increases are lower for sentence structure without meaning (``Jabberwocky'' sentences) and word meaning without sentence structure (word-lists), showing that this effect is not explained by responses to syntax or word meaning alone. Instead, the full effect is found only for sentences, implicating compositional processes of sentence understanding, a striking and unique feature of human language not shared with animal communication systems. This work opens up new avenues for investigating the sequence of neural events that underlie the construction of linguistic meaning.1 aFedorenko, Evelina1 aScott, Terri, L.1 aBrunner, Peter1 aCoon, William, G.1 aPritchett, Brianna1 aSchalk, Gerwin1 aKanwisher, Nancy uhttp://www.ncbi.nlm.nih.gov/pubmed/2767164202115nas a2200205 4500008004100000022001400041245009100055210006900146260000800215300001400223490000800237520151200245100001701757700001501774700001901789700001801808700001601826700001901842856004801861 2016 eng d a1095-957200aOscillatory phase modulates the timing of neuronal activations and resulting behavior.0 aOscillatory phase modulates the timing of neuronal activations a cJun a294–3010 v1333 aHuman behavioral response timing is highly variable from trial to trial. While it is generally understood that behavioral variability must be due to trial-by-trial variations in brain function, it is still largely unknown which physiological mechanisms govern the timing of neural activity as it travels through networks of neuronal populations, and how variations in the timing of neural activity relate to variations in the timing of behavior. In our study, we submitted recordings from the cortical surface to novel analytic techniques to chart the trajectory of neuronal population activity across the human cortex in single trials, and found joint modulation of the timing of this activity and of consequent behavior by neuronal oscillations in the alpha band (8-12Hz). Specifically, we established that the onset of population activity tends to occur during the trough of oscillatory activity, and that deviations from this preferred relationship are related to changes in the timing of population activity and the speed of the resulting behavioral response. These results indicate that neuronal activity incurs variable delays as it propagates across neuronal populations, and that the duration of each delay is a function of the instantaneous phase of oscillatory activity. We conclude that the results presented in this paper are supportive of a general model for variability in the effective speed of information transmission in the human brain and for variability in the timing of human behavior.1 aCoon, W., G.1 aGunduz, A.1 aBrunner, Peter1 aRitaccio, A L1 aPesaran, B.1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2697555102409nas a2200217 4500008004100000022001400041245012900055210006900184260000800253300001300261490000700274520171000281100002701991700002502018700002402043700002002067700001902087700001802106700001902124856004802143 2016 eng d a1932-620300aSpatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task.0 aSpatioTemporal Progression of Cortical Activity Related to Conti cNov ae01668720 v113 aHow the human brain plans, executes, and monitors continuous and fluent speech has remained largely elusive. For example, previous research has defined the cortical locations most important for different aspects of speech function, but has not yet yielded a definition of the temporal progression of involvement of those locations as speech progresses either overtly or covertly. In this paper, we uncovered the spatio-temporal evolution of neuronal population-level activity related to continuous overt speech, and identified those locations that shared activity characteristics across overt and covert speech. Specifically, we asked subjects to repeat continuous sentences aloud or silently while we recorded electrical signals directly from the surface of the brain (electrocorticography (ECoG)). We then determined the relationship between cortical activity and speech output across different areas of cortex and at sub-second timescales. The results highlight a spatio-temporal progression of cortical involvement in the continuous speech process that initiates utterances in frontal-motor areas and ends with the monitoring of auditory feedback in superior temporal gyrus. Direct comparison of cortical activity related to overt versus covert conditions revealed a common network of brain regions involved in speech that may implement orthographic and phonological processing. Our results provide one of the first characterizations of the spatiotemporal electrophysiological representations of the continuous speech process, and also highlight the common neural substrate of overt and covert speech. These results thereby contribute to a refined understanding of speech functions in the human brain.1 aBrumberg, Jonathan, S.1 aKrusienski, Dean, J.1 aChakrabarti, Shreya1 aGunduz, Aysegul1 aBrunner, Peter1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2787559002154nas a2200217 4500008004100000022001400041245008300055210006900138260000800207300001000215490000600225520150300231100002301734700001901757700002101776700002701797700001901824700002301843700002201866856004801888 2016 eng d a2045-232200aWord pair classification during imagined speech using direct brain recordings.0 aWord pair classification during imagined speech using direct bra cMay a258030 v63 aPeople that cannot communicate due to neurological disorders would benefit from an internal speech decoder. Here, we showed the ability to classify individual words during imagined speech from electrocorticographic signals. In a word imagery task, we used high gamma (70-150þinspaceHz) time features with a support vector machine model to classify individual words from a pair of words. To account for temporal irregularities during speech production, we introduced a non-linear time alignment into the SVM kernel. Classification accuracy reached 88% in a two-class classification framework (50% chance level), and average classification accuracy across fifteen word-pairs was significant across five subjects (meanþinspace=þinspace58%; pþinspace<þinspace0.05). We also compared classification accuracy between imagined speech, overt speech and listening. As predicted, higher classification accuracy was obtained in the listening and overt speech conditions (meanþinspace=þinspace89% and 86%, respectively; pþinspace<þinspace0.0001), where speech stimuli were directly presented. The results provide evidence for a neural representation for imagined words in the temporal lobe, frontal lobe and sensorimotor cortex, consistent with previous findings in speech perception and production. These data represent a proof of concept study for basic decoding of speech imagery, and delineate a number of key challenges to usage of speech imagery neural representations for clinical applications.1 aMartin, Stéphanie1 aBrunner, Peter1 aIturrate, Iñaki1 aMillán, José, Del R.1 aSchalk, Gerwin1 aKnight, Robert, T.1 aPasley, Brian, N. uhttp://www.ncbi.nlm.nih.gov/pubmed/2716545202272nas a2200277 4500008004100000245008600041210006900127260001200196520140600208653003301614653002901647653002001676653000901696653002501705653002401730653002001754653002201774100001401796700001401810700002401824700001501848700001901863700001901882700001601901856007701917 2015 eng d00aBrain-to-text: Decoding spoken sentences from phone representations in the brain.0 aBraintotext Decoding spoken sentences from phone representations c06/20153 aIt has long been speculated whether communication between humans and machines based on natural speech related cortical activity is possible. Over the past decade, studies have suggested that it is feasible to recognize isolated aspects of speech from neural signals, such as auditory features, phones or one of a few isolated words. However, until now it remained an unsolved challenge to decode continuously spoken speech from the neural substrate associated with speech and language processing. Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings.Specifically, we implemented a system, which we call Brain-To-Text that models single phones, employs techniques from automatic speech recognition (ASR), and thereby transforms brain activity while speaking into the corresponding textual representation. Our results demonstrate that our system can achieve word error rates as low as 25% and phone error rates below 50%. Additionally, our approach contributes to the current understanding of the neural basis of continuous speech production by identifying those cortical regions that hold substantial information about individual phones. In conclusion, the Brain-To- Text system described in this paper represents an important step toward human-machine communication based on imagined speech.10aautomatic speech recognition10abrain-computer interface10abroadband gamma10aECoG10aElectrocorticography10apattern recognition10aspeech decoding10aspeech production1 aHerff, C.1 aHeger, D.1 ade Pesters, Adriana1 aTelaar, D.1 aBrunner, Peter1 aSchalk, Gerwin1 aSchultz, T. uhttp://journal.frontiersin.org/article/10.3389/fnins.2015.00217/abstract01280nas a2200205 4500008004100000022001400041245008500055210006900140260000800209300001100217490000700228520068900235653001600924100001200940700001700952700001900969700001900988700001901007856004801026 2015 eng d a1741-255200aThe effects of spatial filtering and artifacts on electrocorticographic signals.0 aeffects of spatial filtering and artifacts on electrocorticograp cOct a0560080 v123 aElectrocorticographic (ECoG) signals contain noise that is common to all channels and noise that is specific to individual channels. Most published ECoG studies use common average reference (CAR) spatial filters to remove common noise, but CAR filters may introduce channel-specific noise into other channels. To address this concern, scientists often remove artifactual channels prior to data analysis. However, removing these channels depends on expert-based labeling and may also discard useful data. Thus, the effects of spatial filtering and artifacts on ECoG signals have been largely unknown. This study aims to quantify these effects and thereby address this gap in knowledge.10aYoung Adult1 aLiu, Y.1 aCoon, W., G.1 ade Pesters, A.1 aBrunner, Peter1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2626844602354nas a2200277 4500008004100000022001400041245008600055210006900141260001200210300000700222490000600229520153700235653003201772653002701804653002601831653002201857653001201879100001801891700002601909700001901935700002001954700001801974700001701992700001902009856004802028 2015 eng d a1662-516100aElectrocorticographic representations of segmental features in continuous speech.0 aElectrocorticographic representations of segmental features in c c02/2015 a970 v93 aAcoustic speech output results from coordinated articulation of dozens of muscles, bones and cartilages of the vocal mechanism. While we commonly take the fluency and speed of our speech productions for granted, the neural mechanisms facilitating the requisite muscular control are not completely understood. Previous neuroimaging and electrophysiology studies of speech sensorimotor control has typically concentrated on speech sounds (i.e., phonemes, syllables and words) in isolation; sentence-length investigations have largely been used to inform coincident linguistic processing. In this study, we examined the neural representations of segmental features (place and manner of articulation, and voicing status) in the context of fluent, continuous speech production. We used recordings from the cortical surface [electrocorticography (ECoG)] to simultaneously evaluate the spatial topography and temporal dynamics of the neural correlates of speech articulation that may mediate the generation of hypothesized gestural or articulatory scores. We found that the representation of place of articulation involved broad networks of brain regions during all phases of speech production: preparation, execution and monitoring. In contrast, manner of articulation and voicing status were dominated by auditory cortical responses after speech had been initiated. These results provide a new insight into the articulatory and auditory processes underlying speech production in terms of their motor requirements and acoustic correlates.10aelectrocorticography (ECoG)10amanner of articulation10aplace of articulation10aspeech processing10avoicing1 aLotte, Fabien1 aBrumberg, Jonathan, S1 aBrunner, Peter1 aGunduz, Aysegul1 aRitaccio, A L1 aGuan, Cuntai1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2575964702118nas a2200217 4500008004100000245008100041210006900122520141400191653002301605653003501628653001901663653003201682100001701714700001901731700002001750700001501770700001801785700002001803700001901823856005801842 2015 eng d00aIdentifying the Attended Speaker Using Electrocorticographic (ECoG) Signals.0 aIdentifying the Attended Speaker Using Electrocorticographic ECo3 aPeople affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control. Thus, they cannot use traditional assistive communication devices that depend on muscle control, or brain-computer interfaces (BCIs) that depend on the ability to control gaze. While auditory and tactile BCIs can provide communication to such individuals, their use typically entails an artificial mapping between the stimulus and the communication intent. This makes these BCIs difficult to learn and use. In this study, we investigated the use of selective auditory attention to natural speech as an avenue for BCI communication. In this approach, the user communicates by directing his/her attention to one of two simultaneously presented speakers. We used electrocorticographic (ECoG) signals in the gamma band (70–170 Hz) to infer the identity of attended speaker, thereby removing the need to learn such an artificial mapping. Our results from twelve human subjects show that a single cortical location over superior temporal gyrus or pre-motor cortex is typically sufficient to identify the attended speaker within 10 s and with 77% accuracy (50% accuracy due to chance). These results lay the groundwork for future studies that may determine the real-time performance of BCIs based on selective auditory attention to speech.10aauditory attention10aBrain-computer interface (BCI)10aCocktail Party10aelectrocorticography (ECoG)1 aDijkstra, K.1 aBrunner, Peter1 aGunduz, Aysegul1 aCoon, W.G.1 aRitaccio, A L1 aFarquhar, Jason1 aSchalk, Gerwin uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776341/01581nas a2200205 4500008004100000020002200041022002200063245003800085210003800123260005700161300001000218520096900228100001901197700001701216700001501233700002301248700001801271700001901289856006701308 2015 eng d a978-3-319-25188-2 a978-3-319-25190-500aTowards an Auditory Attention BCI0 aTowards an Auditory Attention BCI aNew York City, NYbSpringer International Publishing a29-423 aPeople affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control and are no longer able to gesture or speak. For this population, an auditory BCI is one of only a few remaining means of communication. All currently used auditory BCIs require a relatively artificial mapping between a stimulus and a communication output. This mapping is cumbersome to learn and use. Recent studies suggest that electrocorticographic (ECoG) signals in the gamma band (i.e., 70–170 Hz) can be used to infer the identity of auditory speech stimuli, effectively removing the need to learn such an artificial mapping. However, BCI systems that use this physiological mechanism for communication purposes have not yet been described. In this study, we explore this possibility by implementing a BCI2000-based real-time system that uses ECoG signals to identify the attended speaker.1 aBrunner, Peter1 aDijkstra, K.1 aCoon, W.G.1 aMellinger, Jürgen1 aRitaccio, A L1 aSchalk, Gerwin uhttp://link.springer.com/chapter/10.1007%2F978-3-319-25190-5_402627nas a2200277 4500008004100000245009500041210006900136260001200205490000600217520181900223653002602042653001402068653000902082653000802091653002802099653000802127100002202135700002002157700001702177700001902194700001902213700002602232700002302258700002002281856004802301 2014 eng d00aAssessing dynamics, spatial scale, and uncertainty in task-related brain network analyses.0 aAssessing dynamics spatial scale and uncertainty in taskrelated  c03/20140 v83 aThe brain is a complex network of interconnected elements, whose interactions evolve dynamically in time to cooperatively perform specific functions. A common technique to probe these interactions involves multi-sensor recordings of brain activity during a repeated task. Many techniques exist to characterize the resulting task-related activity, including establishing functional networks, which represent the statistical associations between brain areas. Although functional network inference is commonly employed to analyze neural time series data, techniques to assess the uncertainty—both in the functional network edges and the corresponding aggregate measures of network topology—are lacking. To address this, we describe a statistically principled approach for computing uncertainty in functional networks and aggregate network measures in task-related data. The approach is based on a resampling procedure that utilizes the trial structure common in experimental recordings. We show in simulations that this approach successfully identifies functional networks and associated measures of confidence emergent during a task in a variety of scenarios, including dynamically evolving networks. In addition, we describe a principled technique for establishing functional networks based on predetermined regions of interest using canonical correlation. Doing so provides additional robustness to the functional network inference. Finally, we illustrate the use of these methods on example invasive brain voltage recordings collected during an overt speech task. The general strategy described here—appropriate for static and dynamic network inference and different statistical measures of coupling—permits the evaluation of confidence in network measures in a variety of settings common to neuroscience.10acanonical correlation10acoherence10aECoG10aEEG10afunctional connectivity10aMEG1 aStephen, Emily, P1 aLepage, Kyle, Q1 aEden, Uri, T1 aBrunner, Peter1 aSchalk, Gerwin1 aBrumberg, Jonathan, S1 aGuenther, Frank, H1 aKramer, Mark, A uhttp://www.ncbi.nlm.nih.gov/pubmed/2467829502900nas a2200277 4500008004100000245008800041210006900129260001200198490000600210520205900216653001802275653001902293653002502312653002402337653002202361100002302383700001902406700002002425700002402445700002202469700001902491700001902510700002302529700002202552856004802574 2014 eng d00aDecoding spectrotemporal features of overt and covert speech from the human cortex.0 aDecoding spectrotemporal features of overt and covert speech fro c03/20140 v73 aAuditory perception and auditory imagery have been shown to activate overlapping brain regions. We hypothesized that these phenomena also share a common underlying neural representation. To assess this, we used electrocorticography intracranial recordings from epileptic patients performing an out loud or a silent reading task. In these tasks, short stories scrolled across a video screen in two conditions: subjects read the same stories both aloud (overt) and silently (covert). In a control condition the subject remained in a resting state. We first built a high gamma (70–150 Hz) neural decoding model to reconstruct spectrotemporal auditory features of self-generated overt speech. We then evaluated whether this same model could reconstruct auditory speech features in the covert speech condition. Two speech models were tested: a spectrogram and a modulation-based feature space. For the overt condition, reconstruction accuracy was evaluated as the correlation between original and predicted speech features, and was significant in each subject (p < 0.00001; paired two-sample t-test). For the covert speech condition, dynamic time warping was first used to realign the covert speech reconstruction with the corresponding original speech from the overt condition. Reconstruction accuracy was then evaluated as the correlation between original and reconstructed speech features. Covert reconstruction accuracy was compared to the accuracy obtained from reconstructions in the baseline control condition. Reconstruction accuracy for the covert condition was significantly better than for the control condition (p < 0.005; paired two-sample t-test). The superior temporal gyrus, pre- and post-central gyrus provided the highest reconstruction information. The relationship between overt and covert speech reconstruction depended on anatomy. These results provide evidence that auditory representations of covert speech can be reconstructed from models that are built from an overt speech data set, supporting a partially shared neural substrate.10acovert speech10adecoding model10aElectrocorticography10apattern recognition10aspeech production1 aMartin, Stéphanie1 aBrunner, Peter1 aHoldgraf, Chris1 aHeinze, Hans-Jochen1 aCrone, Nathan, E.1 aRieger, Jochem1 aSchalk, Gerwin1 aKnight, Robert, T.1 aPasley, Brian, N. uhttp://www.ncbi.nlm.nih.gov/pubmed/2490440401857nas a2200421 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520059500243653001800838653002900856653003500885653002500920653002300945653004300968653003201011653002101043653002201064653001801086100001801104700001901122700002001141700001701161700002401178700001901202700002101221700002001242700002301262700002201285700001601307700002401323700002101347700001901368856004801387 2014 eng d a1525-506900aProceedings of the Fifth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fifth International Workshop on Advances in E c12/2014 a183-920 v413 a

The Fifth International Workshop on Advances in Electrocorticography convened in San Diego, CA, on November 7-8, 2013. Advancements in methodology, implementation, and commercialization across both research and in the interval year since the last workshop were the focus of the gathering. Electrocorticography (ECoG) is now firmly established as a preferred signal source for advanced research in functional, cognitive, and neuroprosthetic domains. Published output in ECoG fields has increased tenfold in the past decade. These proceedings attempt to summarize the state of the art.

10aBrain Mapping10abrain-computer interface10aelectrical stimulation mapping10aElectrocorticography10afunctional mapping10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aGunduz, Aysegul1 aHermes, Dora1 aHirsch, Lawrence, J1 aJacobs, Joshua1 aKamada, Kyousuke1 aKastner, Sabine1 aKnight, Robert, T.1 aLesser, Ronald, P1 aMiller, Kai1 aSejnowski, Terrence1 aWorrell, Gregory1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2546121302881nas a2200397 4500008004100000022001400041245011100055210006900166260001200235300001100247490000700258520172500265653001501990653002002005653001802025653002002043653002502063653002702088653002402115653001102139653001102150653001302161653002902174653003202203653001102235100002602246700001902272700002602291700002402317700001902341700001902360700001802379700002302397700001502420856004802435 2014 eng d a1933-071500aReal-time functional mapping: potential tool for improving language outcome in pediatric epilepsy surgery.0 aRealtime functional mapping potential tool for improving languag c09/2014 a287-950 v143 a

Accurate language localization expands surgical treatment options for epilepsy patients and reduces the risk of postsurgery language deficits. Electrical cortical stimulation mapping (ESM) is considered to be the clinical gold standard for language localization. While ESM affords clinically valuable results, it can be poorly tolerated by children, requires active participation and compliance, carries a risk of inducing seizures, is highly time consuming, and is labor intensive. Given these limitations, alternative and/or complementary functional localization methods such as analysis of electrocorticographic (ECoG) activity in high gamma frequency band in real time are needed to precisely identify eloquent cortex in children. In this case report, the authors examined 1) the use of real-time functional mapping (RTFM) for language localization in a high gamma frequency band derived from ECoG to guide surgery in an epileptic pediatric patient and 2) the relationship of RTFM mapping results to postsurgical language outcomes. The authors found that RTFM demonstrated relatively high sensitivity (75%) and high specificity (90%) when compared with ESM in a "next-neighbor" analysis. While overlapping with ESM in the superior temporal region, RTFM showed a few other areas of activation related to expressive language function, areas that were eventually resected during the surgery. The authors speculate that this resection may be associated with observed postsurgical expressive language deficits. With additional validation in more subjects, this finding would suggest that surgical planning and associated assessment of the risk/benefit ratio would benefit from information provided by RTFM mapping.

10aAdolescent10aAnticonvulsants10aBrain Mapping10aCerebral Cortex10aElectric Stimulation10aElectroencephalography10aEpilepsies, Partial10aFemale10aHumans10aLanguage10aNeuropsychological Tests10aSensitivity and Specificity10aSpeech1 aKorostenskaja, Milena1 aChen, Po-Ching1 aSalinas, Christine, M1 aWesterveld, Michael1 aBrunner, Peter1 aSchalk, Gerwin1 aCook, Jane, C1 aBaumgartner, James1 aLee, Ki, H uhttp://www.ncbi.nlm.nih.gov/pubmed/2499581502800nas a2200349 4500008004100000245012100041210006900162260001200231520168800243653003501931653002501966653003201991653002102023653004902044653002302093653001502116653001302131100002602144700002002170700002102190700001902211700001902230700001702249700002602266700002102292700002002313700001802333700001902351700001702370700001502387856004802402 2014 eng d00aReal-Time Functional Mapping with Electrocorticography in Pediatric Epilepsy: Comparison with fMRI and ESM Findings.0 aRealTime Functional Mapping with Electrocorticography in Pediatr c07/20143 aSIGFRIED (SIGnal modeling For Real-time Identification and Event Detection) software provides real-time functional mapping (RTFM) of eloquent cortex for epilepsy patients preparing to undergo resective surgery. This study presents the first application of paradigms used in functional magnetic resonance (fMRI) and electrical cortical stimulation mapping (ESM) studies for shared functional cortical mapping in the context of RTFM. Results from the 3 modalities are compared. A left-handed 13-year-old male with intractable epilepsy participated in functional mapping for localization of eloquent language cortex with fMRI, ESM, and RTFM. For RTFM, data were acquired over the frontal and temporal cortex. Several paradigms were sequentially presented: passive (listening to stories) and active (picture naming and verb generation). For verb generation and story processing, fMRI showed atypical right lateralizing language activation within temporal lobe regions of interest and bilateral frontal activation with slight right lateralization. Left hemisphere ESM demonstrated no eloquent language areas. RTFM procedures using story processing and picture naming elicited activity in the right lateral and basal temporal regions. Verb generation elicited strong right lateral temporal lobe activation, as well as left frontal lobe activation. RTFM results confirmed atypical language lateralization evident from fMRI and ESM. We demonstrated the feasibility and usefulness of a new RTFM stimulation paradigm during presurgical evaluation. Block design paradigms used in fMRI may be optimal for this purpose. Further development is needed to create age-appropriate RTFM test batteries.10aBrain-computer interface (BCI)10acortical stimulation10aelectrocorticography (ECoG)10aepilepsy surgery10afunctional magnetic resonance imaging (fMRI)10afunctional mapping10apediatrics10aSIGFRIED1 aKorostenskaja, Milena1 aWilson, Adam, J1 aRose, Douglas, F1 aBrunner, Peter1 aSchalk, Gerwin1 aLeach, James1 aMangano, Francesco, T1 aFujiwara, Hisako1 aRozhkov, Leonid1 aHarris, Elana1 aChen, Po-Ching1 aSeo, Joo-Hee1 aLee, Ki, H uhttp://www.ncbi.nlm.nih.gov/pubmed/2429316102940nas a2200229 4500008004100000245006800041210006600109260001200175520223700187653002402424653002502448653002302473653002202496653002602518100001702544700002502561700001902586700002002605700001802625700001902643856004802662 2014 eng d00aSimultaneous Real-Time Monitoring of Multiple Cortical Systems.0 aSimultaneous RealTime Monitoring of Multiple Cortical Systems c10/20143 aOBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.10aauditory processing10aElectrocorticography10amovement intention10arealtime decoding10asimultaneous decoding1 aGupta, Disha1 aHill, Jeremy, Jeremy1 aBrunner, Peter1 aGunduz, Aysegul1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2508016103446nas a2200253 4500008004100000245011700041210006900158260001200227300001100239490000700250520261100257653003402868653002402902653003202926653002802958653002202986653003403008100002103042700001903063700002003082700002303102700001903125856004803144 2014 eng d00aSpatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing.0 aSpatial and temporal relationships of electrocorticographic alph c08/2014 a188-950 v973 aNeuroimaging approaches have implicated multiple brain sites in musical perception, including the posterior part of the superior temporal gyrus and adjacent perisylvian areas. However, the detailed spatial and temporal relationship of neural signals that support auditory processing is largely unknown. In this study, we applied a novel inter-subject analysis approach to electrophysiological signals recorded from the surface of the brain (electrocorticography (ECoG)) in ten human subjects. This approach allowed us to reliably identify those ECoG features that were related to the processing of a complex auditory stimulus (i.e., continuous piece of music) and to investigate their spatial, temporal, and causal relationships. Our results identified stimulus-related modulations in the alpha (8-12 Hz) and high gamma (70-110 Hz) bands at neuroanatomical locations implicated in auditory processing. Specifically, we identified stimulus-related ECoG modulations in the alpha band in areas adjacent to primary auditory cortex, which are known to receive afferent auditory projections from the thalamus (80 of a total of 15,107 tested sites). In contrast, we identified stimulus-related ECoG modulations in the high gamma band not only in areas close to primary auditory cortex but also in other perisylvian areas known to be involved in higher-order auditory processing, and in superior premotor cortex (412/15,107 sites). Across all implicated areas, modulations in the high gamma band preceded those in the alpha band by 280 ms, and activity in the high gamma band causally predicted alpha activity, but not vice versa (Granger causality, p<1e(-8)). Additionally, detailed analyses using Granger causality identified causal relationships of high gamma activity between distinct locations in early auditory pathways within superior temporal gyrus (STG) and posterior STG, between posterior STG and inferior frontal cortex, and between STG and premotor cortex. Evidence suggests that these relationships reflect direct cortico-cortical connections rather than common driving input from subcortical structures such as the thalamus. In summary, our inter-subject analyses defined the spatial and temporal relationships between music-related brain activity in the alpha and high gamma bands. They provide experimental evidence supporting current theories about the putative mechanisms of alpha and gamma activity, i.e., reflections of thalamo-cortical interactions and local cortical neural activity, respectively, and the results are also in agreement with existing functional models of auditory processing.10aalpha and high gamma activity10aauditory processing10aelectrocorticography (ECoG)10afunctional connectivity10agranger causality10athalamo-cortical interactions1 aPotes, Cristhian1 aBrunner, Peter1 aGunduz, Aysegul1 aKnight, Robert, T.1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2476893301886nas a2200397 4500008004100000245009000041210006900131260001200200300001300212490000700225520069800232653001800930653003100948653002500979653004301004653003201047653002101079653002201100653001801122100001801140700001901158700002201177700002001199700002501219700002101244700001601265700001901281700001901300700001901319700002001338700002401358700001801382700002101400700001901421856004801440 2013 eng d00aProceedings of the Fourth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fourth International Workshop on Advances in  c11/2013 a259–680 v293 aThe Fourth International Workshop on Advances in Electrocorticography (ECoG) convened in New Orleans, LA, on October 11–12, 2012. The proceedings of the workshop serves as an accurate record of the most contemporary clinical and experimental work on brain surface recording and represents the insights of a unique multidisciplinary ensemble of expert clinicians and scientists. Presentations covered a broad range of topics, including innovations in passive functional mapping, increased understanding of pathologic high-frequency oscillations, evolving sensor technologies, a human trial of ECoG-driven brain–machine interface, as well as fresh insights into brain electrical stimulation.10aBrain Mapping10aBrain–computer interface10aElectrocorticography10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aHirsch, Lawrence, J.1 aKanwisher, Nancy1 aLitt, Brian1 aMiller, Kai, J1 aMorani, Daniel1 aParvizi, Josef1 aRamsey, Nick, F1 aRichner, Thomas, J.1 aTandon, Niton1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2403489900398nas a2200133 4500008004100000245005500041210005200096260001200148300001000160490000800170100001900178700001900197856004800216 2013 eng d00aToward Gaze-Independent Brain-Computer Interfaces.0 aToward GazeIndependent BrainComputer Interfaces c05/2013 a831-30 v1251 aBrunner, Peter1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2346543102234nas a2200181 4500008004100000245005700041210005200098260001200150300001400162490000600176520172300182100001701905700001901922700002001941700001901961700001901980856005301999 2013 eng d00aThe Tracking of Speech Envelope in the Human Cortex.0 aTracking of Speech Envelope in the Human Cortex c01/2013 ae53398 - 0 v83 aHumans are highly adept at processing speech. Recently, it has been shown that slow temporal information in speech (i.e., the envelope of speech) is critical for speech comprehension. Furthermore, it has been found that evoked electric potentials in human cortex are correlated with the speech envelope. However, it has been unclear whether this essential linguistic feature is encoded differentially in specific regions, or whether it is represented throughout the auditory system. To answer this question, we recorded neural data with high temporal resolution directly from the cortex while human subjects listened to a spoken story. We found that the gamma activity in human auditory cortex robustly tracks the speech envelope. The effect is so marked that it is observed during a single presentation of the spoken story to each subject. The effect is stronger in regions situated relatively early in the auditory pathway (belt areas) compared to other regions involved in speech processing, including the superior temporal gyrus (STG) and the posterior inferior frontal gyrus (Broca's region). To further distinguish whether speech envelope is encoded in the auditory system as a phonological (speech-related), or instead as a more general acoustic feature, we also probed the auditory system with a melodic stimulus. We found that belt areas track melody envelope weakly, and as the only region considered. Together, our data provide the first direct electrophysiological evidence that the envelope of speech is robustly tracked in non-primary auditory cortex (belt areas in particular), and suggest that the considered higher-order regions (STG and Broca's region) partake in a more abstract linguistic analysis.1 aKubanek, Jan1 aBrunner, Peter1 aGunduz, Aysegul1 aPoeppel, David1 aSchalk, Gerwin uhttp://dx.doi.org/10.1371%2Fjournal.pone.005339801823nas a2200253 4500008004100000022001400041245009200055210006900147260001200216300001200228490000700240520106200247653002101309653003201330653002901362100002001391700001901411700001601430700001901446700001801465700001901483700001901502856004801521 2012 eng d a1095-957200aDecoding covert spatial attention using electrocorticographic (ECoG) signals in humans.0 aDecoding covert spatial attention using electrocorticographic EC c05/2012 a2285-930 v603 a

This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.

10acovert attention10aelectrocorticography (ECoG)10avisual spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2236633301958nas a2200253 4500008004100000245010000041210006900141260001200210490000600222520117500228653002901403653000901432653003401441653003001475653002401505653002901529100001201558700002001570700001901590700001801609700001001627700001901637856004801656 2012 eng d00aDecoding Onset and Direction of Movements using Electrocorticographic (ECoG) Signals in Humans.0 aDecoding Onset and Direction of Movements using Electrocorticogr c08/20120 v53 aCommunication of intent usually requires motor function. This requirement can be limiting when a person is engaged in a task, or prohibitive for some people suffering from neuromuscular disorders. Determining a person's intent, e.g., where and when to move, from brain signals rather than from muscles would have important applications in clinical or other domains. For example, detection of the onset and direction of intended movements may provide the basis for restoration of simple grasping function in people with chronic stroke, or could be used to optimize a user's interaction with the surrounding environment. Detecting the onset and direction of actual movements are a first step in this direction. In this study, we demonstrate that we can detect the onset of intended movements and their direction using electrocorticographic (ECoG) signals recorded from the surface of the cortex in humans. We also demonstrate in a simulation that the information encoded in ECoG about these movements may improve performance in a targeting task. In summary, the results in this paper suggest that detection of intended movement is possible, and may serve useful functions.10abrain computer interface10aECoG10amovement direction prediction10amovement onset prediction10aneurorehabilitation10aperformance augmentation1 aWang, Z1 aGunduz, Aysegul1 aBrunner, Peter1 aRitaccio, A L1 aJi, Q1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2289105803280nas a2200229 4500008004100000022001400041245012300055210006900178260001200247300001000259490000700269520254700276653002402823653003202847653002402879653002002903100002102923700002002944700001902964700001902983856004803002 2012 eng d a1095-957200aDynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening.0 aDynamics of electrocorticographic ECoG activity in human tempora c07/2012 a841-80 v613 a

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

10aauditory processing10aelectrocorticography (ECoG)10ahigh gamma activity10asound intensity1 aPotes, Cristhian1 aGunduz, Aysegul1 aBrunner, Peter1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2253760001889nas a2200469 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520052900243653001800772653002900790653002500819653004300844653003100887653002100918653002200939653001800961100001800979700002300997700002001020700001901040700001801059700002201077700002001099700001701119700002301136700002001159700001601179700001801195700002101213700001901234700001701253700001901270700002201289700002001311700002101331700001901352856004801371 2012 eng d a1525-506900aProceedings of the Third International Workshop on Advances in Electrocorticography.0 aProceedings of the Third International Workshop on Advances in E c12/2012 a605-130 v253 aThe Third International Workshop on Advances in Electrocorticography (ECoG) was convened in Washington, DC, on November 10-11, 2011. As in prior meetings, a true multidisciplinary fusion of clinicians, scientists, and engineers from many disciplines gathered to summarize contemporary experiences in brain surface recordings. The proceedings of this meeting serve as evidence of a very robust and transformative field but will yet again require revision to incorporate the advances that the following year will surely bring.10aBrain Mapping10abrain-computer interface10aElectrocorticography10aGamma-frequency electroencephalography10ahigh-frequency oscillation10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBeauchamp, Michael1 aBosman, Conrado1 aBrunner, Peter1 aChang, Edward1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aGupta, Disha1 aKnight, Robert, T.1 aLeuthardt, Eric1 aLitt, Brian1 aMoran, Daniel1 aOjemann, Jeffrey1 aParvizi, Josef1 aRamsey, Nick1 aRieger, Jochem1 aViventi, Jonathan1 aVoytek, Bradley1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2316009610628nas a2200313 4500008004100000022001400041245012900055210006900184260001200253520965800265653001209923653003109935653002509966653002409991653002910015653001310044653003110057653000810088653001710096653001310113100002510126700001710151700001910168700002010187700002210207700001810229700001910247856004810266 2012 eng d a1940-087X00aRecording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping.0 aRecording Human Electrocorticographic ECoG Signals for Neuroscie c05/20123 a

Neuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), magnetoencephalography or functional magnetic-resonance imaging. These techniques have either inherently low temporal or low spatial resolution, and suffer from low signal-to-noise ratio and/or poor high-frequency sensitivity. Thus, they are suboptimal for exploring the short-lived spatio-temporal dynamics of many of the underlying brain processes. In contrast, the invasive technique of electrocorticography (ECoG) provides brain signals that have an exceptionally high signal-to-noise ratio, less susceptibility to artifacts than EEG, and a high spatial and temporal resolution (i.e., <1 cm/<1 millisecond, respectively). ECoG involves measurement of electrical brain signals using electrodes that are implanted subdurally on the surface of the brain. Recent studies have shown that ECoG amplitudes in certain frequency bands carry substantial information about task-related activity, such as motor execution and planning, auditory processing and visual-spatial attention. Most of this information is captured in the high gamma range (around 70-110 Hz). Thus, gamma activity has been proposed as a robust and general indicator of local cortical function. ECoG can also reveal functional connectivity and resolve finer task-related spatial-temporal dynamics, thereby advancing our understanding of large-scale cortical processes. It has especially proven useful for advancing brain-computer interfacing (BCI) technology for decoding a user's intentions to enhance or improve communication and control. Nevertheless, human ECoG data are often hard to obtain because of the risks and limitations of the invasive procedures involved, and the need to record within the constraints of clinical settings. Still, clinical monitoring to localize epileptic foci offers a unique and valuable opportunity to collect human ECoG data. We describe our methods for collecting recording ECoG, and demonstrate how to use these signals for important real-time applications such as clinical mapping and brain-computer interfacing. Our example uses the BCI2000 software platform and the SIGFRIED method, an application for real-time mapping of brain functions. This procedure yields information that clinicians can subsequently use to guide the complex and laborious process of functional mapping by electrical stimulation. PREREQUISITES AND PLANNING: Patients with drug-resistant partial epilepsy may be candidates for resective surgery of an epileptic focus to minimize the frequency of seizures. Prior to resection, the patients undergo monitoring using subdural electrodes for two purposes: first, to localize the epileptic focus, and second, to identify nearby critical brain areas (i.e., eloquent cortex) where resection could result in long-term functional deficits. To implant electrodes, a craniotomy is performed to open the skull. Then, electrode grids and/or strips are placed on the cortex, usually beneath the dura. A typical grid has a set of 8 x 8 platinum-iridium electrodes of 4 mm diameter (2.3 mm exposed surface) embedded in silicon with an inter-electrode distance of 1cm. A strip typically contains 4 or 6 such electrodes in a single line. The locations for these grids/strips are planned by a team of neurologists and neurosurgeons, and are based on previous EEG monitoring, on a structural MRI of the patient's brain, and on relevant factors of the patient's history. Continuous recording over a period of 5-12 days serves to localize epileptic foci, and electrical stimulation via the implanted electrodes allows clinicians to map eloquent cortex. At the end of the monitoring period, explantation of the electrodes and therapeutic resection are performed together in one procedure. In addition to its primary clinical purpose, invasive monitoring also provides a unique opportunity to acquire human ECoG data for neuroscientific research. The decision to include a prospective patient in the research is based on the planned location of their electrodes, on the patient's performance scores on neuropsychological assessments, and on their informed consent, which is predicated on their understanding that participation in research is optional and is not related to their treatment. As with all research involving human subjects, the research protocol must be approved by the hospital's institutional review board. The decision to perform individual experimental tasks is made day-by-day, and is contingent on the patient's endurance and willingness to participate. Some or all of the experiments may be prevented by problems with the clinical state of the patient, such as post-operative facial swelling, temporary aphasia, frequent seizures, post-ictal fatigue and confusion, and more general pain or discomfort. At the Epilepsy Monitoring Unit at Albany Medical Center in Albany, New York, clinical monitoring is implemented around the clock using a 192-channel Nihon-Kohden Neurofax monitoring system. Research recordings are made in collaboration with the Wadsworth Center of the New York State Department of Health in Albany. Signals from the ECoG electrodes are fed simultaneously to the research and the clinical systems via splitter connectors. To ensure that the clinical and research systems do not interfere with each other, the two systems typically use separate grounds. In fact, an epidural strip of electrodes is sometimes implanted to provide a ground for the clinical system. Whether research or clinical recording system, the grounding electrode is chosen to be distant from the predicted epileptic focus and from cortical areas of interest for the research. Our research system consists of eight synchronized 16-channel g.USBamp amplifier/digitizer units (g.tec, Graz, Austria). These were chosen because they are safety-rated and FDA-approved for invasive recordings, they have a very low noise-floor in the high-frequency range in which the signals of interest are found, and they come with an SDK that allows them to be integrated with custom-written research software. In order to capture the high-gamma signal accurately, we acquire signals at 1200Hz sampling rate-considerably higher than that of the typical EEG experiment or that of many clinical monitoring systems. A built-in low-pass filter automatically prevents aliasing of signals higher than the digitizer can capture. The patient's eye gaze is tracked using a monitor with a built-in Tobii T-60 eye-tracking system (Tobii Tech., Stockholm, Sweden). Additional accessories such as joystick, bluetooth Wiimote (Nintendo Co.), data-glove (5(th) Dimension Technologies), keyboard, microphone, headphones, or video camera are connected depending on the requirements of the particular experiment. Data collection, stimulus presentation, synchronization with the different input/output accessories, and real-time analysis and visualization are accomplished using our BCI2000 software. BCI2000 is a freely available general-purpose software system for real-time biosignal data acquisition, processing and feedback. It includes an array of pre-built modules that can be flexibly configured for many different purposes, and that can be extended by researchers' own code in C++, MATLAB or Python. BCI2000 consists of four modules that communicate with each other via a network-capable protocol: a Source module that handles the acquisition of brain signals from one of 19 different hardware systems from different manufacturers; a Signal Processing module that extracts relevant ECoG features and translates them into output signals; an Application module that delivers stimuli and feedback to the subject; and the Operator module that provides a graphical interface to the investigator. A number of different experiments may be conducted with any given patient. The priority of experiments will be determined by the location of the particular patient's electrodes. However, we usually begin our experimentation using the SIGFRIED (SIGnal modeling For Realtime Identification and Event Detection) mapping method, which detects and displays significant task-related activity in real time. The resulting functional map allows us to further tailor subsequent experimental protocols and may also prove as a useful starting point for traditional mapping by electrocortical stimulation (ECS). Although ECS mapping remains the gold standard for predicting the clinical outcome of resection, the process of ECS mapping is time consuming and also has other problems, such as after-discharges or seizures. Thus, a passive functional mapping technique may prove valuable in providing an initial estimate of the locus of eloquent cortex, which may then be confirmed and refined by ECS. The results from our passive SIGFRIED mapping technique have been shown to exhibit substantial concurrence with the results derived using ECS mapping. The protocol described in this paper establishes a general methodology for gathering human ECoG data, before proceeding to illustrate how experiments can be initiated using the BCI2000 software platform. Finally, as a specific example, we describe how to perform passive functional mapping using the BCI2000-based SIGFRIED system.

10aBCI200010abrain-computer interfacing10aElectrocorticography10aepilepsy monitoring10afunctional brain mapping10aissue 6410aMagnetic Resonance Imaging10aMRI10aneuroscience10aSIGFRIED1 aHill, Jeremy, Jeremy1 aGupta, Disha1 aBrunner, Peter1 aGunduz, Aysegul1 aAdamo, Matthew, A1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2278213107041nas a2200313 4500008004100000022001400041245008200055210006900137260001200206300001100218490000600229520615100235653002806386653001006414653001806424653002706442653002106469653003106490653001106521653002406532653001306556653002806569100001906597700001506616700001306631700001606644700001906660856004806679 2011 eng d a1741-255200aCurrent Trends in Hardware and Software for Brain-Computer Interfaces (BCIs).0 aCurrent Trends in Hardware and Software for BrainComputer Interf c04/2011 a0250010 v83 a

brain-computer interface (BCI) provides a non-muscular communication channel to people with and without disabilities. BCI devices consist of hardware and software. BCI hardware records signals from the brain, either invasively or non-invasively, using a series of device components. BCI software then translates these signals into device output commands and provides feedback. One may categorize different types of BCI applications into the following four categories: basic research, clinical/translational research, consumer products, and emerging applications. These four categories use BCI hardware and software, but have different sets of requirements. For example, while basic research needs to explore a wide range of system configurations, and thus requires a wide range of hardware and software capabilities, applications in the other three categories may be designed for relatively narrow purposes and thus may only need a very limited subset of capabilities. This paper summarizes technical aspects for each of these four categories of BCI applications. The results indicate that BCI technology is in transition from isolated demonstrations to systematic research and commercial development. This process requires several multidisciplinary efforts, including the development of better integrated and more robust BCI hardware and software, the definition of standardized interfaces, and the developmentof certification, dissemination and reimbursement procedures.

10aBiofeedback, Psychology10aBrain10aBrain Mapping10aElectroencephalography10aEquipment Design10aEquipment Failure Analysis10aHumans10aMan-Machine Systems10aSoftware10aUser-Computer Interface1 aBrunner, Peter1 aBianchi, L1 aGuger, C1 aCincotti, F1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2143653602535nas a2200277 4500008004100000022001400041245009300055210006900148260001200217300000700229490000600236520172900242653002101971653002501992653001402017653001902031653002902050100002002079700001902099700001602118700001902134700001802153700001902171700001902190856004802209 2011 eng d a1662-516100aNeural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans.0 aNeural Correlates of Covert Attention in Electrocorticographic E c09/2011 a890 v53 a

Attention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.

10acovert attention10aElectrocorticography10aintention10amotor response10avisual-spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2204615302106nas a2200421 4500008004100000022001400041245009000055210006900145260001200214300001100226490000700237520091200244653001001156653001801166653001601184653003301200653002701233653001301260653001101273653001801284653002801302100001801330700002401348700001901372700002701391700002001418700002201438700002001460700002301480700001601503700002001519700001301539700001901552700002201571700002401593700001901617856004801636 2011 eng d a1525-506900aProceedings of the Second International Workshop on Advances in Electrocorticography.0 aProceedings of the Second International Workshop on Advances in  c12/2011 a641-500 v223 a

The Second International Workshop on Advances in Electrocorticography (ECoG) was convened in San Diego, CA, USA, on November 11-12, 2010. Between this meeting and the inaugural 2009 event, a much clearer picture has been emerging of cortical ECoG physiology and its relationship to local field potentials and single-cell recordings. Innovations in material engineering are advancing the goal of a stable long-term recording interface. Continued evolution of ECoG-driven brain-computer interface technology is determining innovation in neuroprosthetics. Improvements in instrumentation and statistical methodologies continue to elucidate ECoG correlates of normal human function as well as the ictal state. This proceedings document summarizes the current status of this rapidly evolving field.

10aBrain10aBrain Mapping10aBrain Waves10aDiagnosis, Computer-Assisted10aElectroencephalography10aEpilepsy10aHumans10aUnited States10aUser-Computer Interface1 aRitaccio, A L1 aBoatman-Reich, Dana1 aBrunner, Peter1 aCervenka, Mackenzie, C1 aCole, Andrew, J1 aCrone, Nathan, E.1 aDuckrow, Robert1 aKorzeniewska, Anna1 aLitt, Brian1 aMiller, John, W1 aMoran, D1 aParvizi, Josef1 aViventi, Jonathan1 aWilliams, Justin, C1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2203628703409nas a2200253 4500008004100000022001400041245009700055210006900152260001200221300000600233490000600239520266600245653002902911653002502940653002802965653000902993653001203002100001903014700001803033700002203051700001503073700001903088856004803107 2011 eng d a1662-453X00aRapid Communication with a "P300" Matrix Speller Using Electrocorticographic Signals (ECoG).0 aRapid Communication with a P300 Matrix Speller Using Electrocort c02/2011 a50 v53 a

brain-computer interface (BCI) can provide a non-muscular communication channel to severely disabled people. One particular realization of a BCI is the P300 matrix speller that was originally described by Farwell and Donchin (1988). This speller uses event-related potentials (ERPs) that include the P300 ERP. All previous online studies of the P300 matrix speller used scalp-recorded electroencephalography (EEG) and were limited in their communication performance to only a few characters per minute. In our study, we investigated the feasibility of using electrocorticographic (ECoG) signals for online operation of the matrix speller, and determined associated spelling rates. We used the matrix speller that is implemented in the BCI2000 system. This speller used ECoG signals that were recorded from frontal, parietal, and occipital areas in one subject. This subject spelled a total of 444 characters in online experiments. The results showed that the subject sustained a rate of 17 characters/min (i.e., 69 bits/min), and achieved a peak rate of 22 characters/min (i.e., 113 bits/min). Detailed analysis of the results suggests that ERPs over visual areas (i.e., visual evoked potentials) contribute significantly to the performance of the matrix speller BCI system. Our results also point to potential reasons for the apparent advantages in spelling performance of ECoG compared to EEG. Thus, with additional verification in more subjects, these results may further extend the communication options for people with serious neuromuscular disabilities.

10abrain-computer interface10aElectrocorticography10aevent-related potential10aP30010aspeller1 aBrunner, Peter1 aRitaccio, A L1 aEmrich, Joseph, F1 aBischof, H1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2136935103279nas a2200337 4500008004100000022001400041245011400055210006900169260001200238300001200250490000700262520231800269653001502587653001002602653001002612653001802622653002702640653001102667653001102678653000902689653001602698653004102714653002002755100001802775700001902793700002202812700001902834700002102853700001902874856004802893 2011 eng d a1095-957200aSpatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition.0 aSpatiotemporal dynamics of electrocorticographic high gamma acti c02/2011 a2960-720 v543 a

Language is one of the defining abilities of humans. Many studies have characterized the neural correlates of different aspects of language processing. However, the imaging techniques typically used in these studies were limited in either their temporal or spatial resolution. Electrocorticographic (ECoG) recordings from the surface of the brain combine high spatial with high temporal resolution and thus could be a valuable tool for the study of neural correlates of language function. In this study, we defined the spatiotemporal dynamics of ECoG activity during a word repetition task in nine human subjects. ECoG was recorded while each subject overtly or covertly repeated words that were presented either visually or auditorily. ECoG amplitudes in the high gamma (HG) band confidently tracked neural changes associated with stimulus presentation and with the subject's verbal response. Overt word production was primarily associated with HG changes in the superior and middle parts of temporal lobe, Wernicke's area, the supramarginal gyrus, Broca's area, premotor cortex (PMC), primary motor cortex. Covert word production was primarily associated with HG changes in superior temporal lobe and the supramarginal gyrus. Acoustic processing from both auditory stimuli as well as the subject's own voice resulted in HG power changes in superior temporal lobe and Wernicke's area. In summary, this study represents a comprehensive characterization of overt and covert speech using electrophysiological imaging with high spatial and temporal resolution. It thereby complements the findings of previous neuroimaging studies of language and thus further adds to current understanding of word processing in humans.

10aAdolescent10aAdult10aBrain10aBrain Mapping10aElectroencephalography10aFemale10aHumans10aMale10aMiddle Aged10aSignal Processing, Computer-Assisted10aVerbal Behavior1 aPei, Xiao-Mei1 aLeuthardt, E C1 aGaona, Charles, M1 aBrunner, Peter1 aWolpaw, Jonathan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2102978400601nas a2200205 4500008004100000022001400041245007100055210006800126260001200194300001100206490000800217653001400225653001000239653002100249653001100270653002800281100001900309700001900328856004800347 2011 eng d a1872-895200aToward a gaze-independent matrix speller brain-computer interface.0 aToward a gazeindependent matrix speller braincomputer interface c06/2011 a1063-40 v12210aAttention10aBrain10aFixation, Ocular10aHumans10aUser-Computer Interface1 aBrunner, Peter1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2118340402830nas a2200337 4500008004100000022001400041245004900055210004500104260001200149300001100161490000600172520196200178653001002140653003502150653001802185653001102203653001102214653000902225653001602234653002502250653002302275653002802298653001602326100001902342700001302361700001502374700002102389700001502410700001902425856004802444 2010 eng d a1741-255200aDoes the 'P300' speller depend on eye gaze?.0 aDoes the P300 speller depend on eye gaze c10/2010 a0560130 v73 a

Many people affected by debilitating neuromuscular disorders such as amyotrophic lateral sclerosis, brainstem stroke or spinal cord injury are impaired in their ability to, or are even unable to, communicate. A brain-computer interface (BCI) uses brain signals, rather than muscles, to re-establish communication with the outside world. One particular BCI approach is the so-called 'P300 matrix speller' that was first described by Farwell and Donchin (1988 Electroencephalogr. Clin. Neurophysiol. 70 510-23). It has been widely assumed that this method does not depend on the ability to focus on the desired character, because it was thought that it relies primarily on the P300-evoked potential and minimally, if at all, on other EEG features such as the visual-evoked potential (VEP). This issue is highly relevant for the clinical application of this BCI method, because eye movements may be impaired or lost in the relevant user population. This study investigated the extent to which the performance in a 'P300' speller BCI depends on eye gaze. We evaluated the performance of 17 healthy subjects using a 'P300' matrix speller under two conditions. Under one condition ('letter'), the subjects focused their eye gaze on the intended letter, while under the second condition ('center'), the subjects focused their eye gaze on a fixation cross that was located in the center of the matrix. The results show that the performance of the 'P300' matrix speller in normal subjects depends in considerable measure on gaze direction. They thereby disprove a widespread assumption in BCI research, and suggest that this BCI might function more effectively for people who retain some eye-movement control. The applicability of these findings to people with severe neuromuscular disabilities (particularly in eye-movements) remains to be determined.

10aAdult10aEvent-Related Potentials, P30010aEye Movements10aFemale10aHumans10aMale10aMiddle Aged10aModels, Neurological10aPhotic Stimulation10aUser-Computer Interface10aYoung Adult1 aBrunner, Peter1 aJoshi, S1 aBriskin, S1 aWolpaw, Jonathan1 aBischof, H1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2085892403481nas a2200289 4500008004100000022001400041245009200055210006900147260001200216300001000228490000700238520264000245653001802885653002002903653002002923653001502943653002502958653002702983653001103010653002703021100001803048700001903066700002003085700001903105700001903124856004803143 2010 eng d a1525-506900aPassive real-time identification of speech and motor cortex during an awake craniotomy.0 aPassive realtime identification of speech and motor cortex durin c05/2010 a123-80 v183 a

Precise localization of eloquent cortex is a clinical necessity prior to surgical resections adjacent to speech or motor cortex. In the intraoperative setting, this traditionally requires inducing temporary lesions by direct electrocortical stimulation (DECS). In an attempt to increase efficiency and potentially reduce the amount of necessary stimulation, we used a passive mapping procedure in the setting of an awake craniotomy for tumor in two patients resection. We recorded electrocorticographic (ECoG) signals from exposed cortex while patients performed simple cue-directed motor and speech tasks. SIGFRIED, a procedure for real-time event detection, was used to identify areas of cortical activation by detecting task-related modulations in the ECoG high gamma band. SIGFRIED's real-time output quickly localized motor and speech areas of cortex similar to those identified by DECS. In conclusion, real-time passive identification of cortical function using SIGFRIED may serve as a useful adjunct to cortical stimulation mapping in the intraoperative setting.

10aBrain Mapping10aBrain Neoplasms10aCerebral Cortex10aCraniotomy10aElectric Stimulation10aElectroencephalography10aHumans10aNeurologic Examination1 aRoland, Jarod1 aBrunner, Peter1 aJohnston, James1 aSchalk, Gerwin1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/2047874501656nas a2200337 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520066900243653001000912653001800922653003300940653002700973653001101000653003001011653001301041653003601054100001801090700001901108700002701127700002201154700001301176700001901189700002301208700002001231700001901251856004801270 2010 eng d a1525-506900aProceedings of the first international workshop on advances in electrocorticography.0 aProceedings of the first international workshop on advances in e c10/2010 a204-150 v193 a

In October 2009, a group of neurologists, neurosurgeons, computational neuroscientists, and engineers congregated to present novel developments transforming human electrocorticography (ECoG) beyond its established relevance in clinical epileptology. The contents of the proceedings advanced the role of ECoG in seizure detection and prediction, neurobehavioral research, functional mapping, and brain-computer interface technology. The meeting established the foundation for future work on the methodology and application of surface brain recordings.

10aBrain10aBrain Mapping10aDiagnosis, Computer-Assisted10aElectroencephalography10aHumans10aInternational Cooperation10aSeizures10aSignal Detection, Psychological1 aRitaccio, A L1 aBrunner, Peter1 aCervenka, Mackenzie, C1 aCrone, Nathan, E.1 aGuger, C1 aLeuthardt, E C1 aOostenveld, Robert1 aStacey, William1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2088938401207nas a2200181 4500008004100000020002200041245003200063210003000095260001900125520069300144653000800837653002900845653002300874653002200897100001900919700001900938856006800957 2009 eng d a978-3-642-02811-300aBrain-Computer Interaction.0 aBrainComputer Interaction bSpringerc20093 a

Detection and automated interpretation of attention-related or intention-related brain activity carries significant promise for many military and civilian applications. This interpretation of brain activity could provide information about a person’s intended movements, imagined movements, or attentional focus, and thus could be valuable for optimizing or replacing traditional motor-based communication between a person and a computer or other output devices. We describe here the objective and preliminary results of our studies in this area.

10aBCI10abrain-computer interface10aneural engineering10aneural prosthesis1 aBrunner, Peter1 aSchalk, Gerwin uhttp://link.springer.com/chapter/10.1007%2F978-3-642-02812-0_8102591nas a2200433 4500008004100000022001400041245012500055210006900180260001200249300001100261490000700272520133300279653001001612653001801622653002001640653002501660653002601685653002701711653001301738653001101751653001101762653000901773653001601782653003301798653004101831653001601872100001901888700001801907700002201925700002201947700002001969700002401989700002302013700002002036700001902056700001502075700001902090856004802109 2009 eng d a1525-506900aA practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans.0 apractical procedure for realtime functional mapping of eloquent  c07/2009 a278-860 v153 a

Functional mapping of eloquent cortex is often necessary prior to invasive brain surgery, but current techniques that derive this mapping have important limitations. In this article, we demonstrate the first comprehensive evaluation of a rapid, robust, and practical mapping system that uses passive recordings of electrocorticographic signals. This mapping procedure is based on the BCI2000 and SIGFRIED technologies that we have been developing over the past several years. In our study, we evaluated 10 patients with epilepsy from four different institutions and compared the results of our procedure with the results derived using electrical cortical stimulation (ECS) mapping. The results show that our procedure derives a functional motor cortical map in only a few minutes. They also show a substantial concurrence with the results derived using ECS mapping. Specifically, compared with ECS maps, a next-neighbor evaluation showed no false negatives, and only 0.46 and 1.10% false positives for hand and tongue maps, respectively. In summary, we demonstrate the first comprehensive evaluation of a practical and robust mapping procedure that could become a new tool for planning of invasive brain surgeries.

10aAdult10aBrain Mapping10aCerebral Cortex10aElectric Stimulation10aElectrodes, Implanted10aElectroencephalography10aEpilepsy10aFemale10aHumans10aMale10aMiddle Aged10aPractice Guidelines as Topic10aSignal Processing, Computer-Assisted10aYoung Adult1 aBrunner, Peter1 aRitaccio, A L1 aLynch, Timothy, M1 aEmrich, Joseph, F1 aWilson, Adam, J1 aWilliams, Justin, C1 aAarnoutse, Erik, J1 aRamsey, Nick, F1 aLeuthardt, E C1 aBischof, H1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/1936663801741nas a2200253 4500008004100000022001400041245008200055210006900137260001200206300001400218490000700232520097500239653000801214653002901222653002201251653002401273100003201297700002601329700002001355700002401375700001901399700002101418856004801439 2009 eng d a1873-624600aA scanning protocol for a sensorimotor rhythm-based brain-computer interface.0 ascanning protocol for a sensorimotor rhythmbased braincomputer i c02/2009 a169–1750 v803 aThe scanning protocol is a novel brain-computer interface (BCI) implementation that can be controlled with sensorimotor rhythms (SMRs) of the electroencephalogram (EEG). The user views a screen that shows four choices in a linear array with one marked as target. The four choices are successively highlighted for 2.5s each. When a target is highlighted, the user can select it by modulating the SMR. An advantage of this method is the capacity to choose among multiple choices with just one learned SMR modulation. Each of 10 naive users trained for ten 30 min sessions over 5 weeks. User performance improved significantly (p<0.001) over the sessions and ranged from 30 to 80% mean accuracy of the last three sessions (chance accuracy=25%). The incidence of correct selections depended on the target position. These results suggest that, with further improvements, a scanning protocol can be effective. The ultimate goal is to expand it to a large matrix of selections.10aBCI10abrain-computer interface10ascanning protocol10asensorimotor rhythm1 aFriedrich, Elisabeth, V. C.1 aMcFarland, Dennis, J.1 aNeuper, Christa1 aVaughan, Theresa, M1 aBrunner, Peter1 aWolpaw, Jonathan uhttp://www.ncbi.nlm.nih.gov/pubmed/1878660302473nas a2200289 4500008004100000022001400041245007500055210006900130260001200199300001600211490000800227520163800235653002901873653002801902653000801930653002801938653000901966653001901975100002101994700002402015700001902039700002102058700002102079700001502100700002002115856004802135 2009 eng d a1872-895200aToward a high-throughput auditory P300-based brain-computer interface.0 aToward a highthroughput auditory P300based braincomputer interfa c07/2009 a1252–12610 v1203 aOBJECTIVE: Brain-computer interface (BCI) technology can provide severely disabled people with non-muscular communication. For those most severely disabled, limitations in eye mobility or visual acuity may necessitate auditory BCI systems. The present study investigates the efficacy of the use of six environmental sounds to operate a 6x6 P300 Speller. METHODS: A two-group design was used to ascertain whether participants benefited from visual cues early in training. Group A (N=5) received only auditory stimuli during all 11 sessions, whereas Group AV (N=5) received simultaneous auditory and visual stimuli in initial sessions after which the visual stimuli were systematically removed. Stepwise linear discriminant analysis determined the matrix item that elicited the largest P300 response and thereby identified the desired choice. RESULTS: Online results and offline analyses showed that the two groups achieved equivalent accuracy. In the last session, eight of 10 participants achieved 50% or more, and four of these achieved 75% or more, online accuracy (2.8% accuracy expected by chance). Mean bit rates averaged about 2 bits/min, and maximum bit rates reached 5.6 bits/min. CONCLUSIONS: This study indicates that an auditory P300 BCI is feasible, that reasonable classification accuracy and rate of communication are achievable, and that the paradigm should be further evaluated with a group of severely disabled participants who have limited visual mobility. SIGNIFICANCE: With further development, this auditory P300 BCI could be of substantial value to severely disabled people who cannot use a visual BCI.10abrain-computer interface10abrain-machine interface10aEEG10aevent-related potential10aP30010aRehabilitation1 aKlobassa, D., S.1 aVaughan, Theresa, M1 aBrunner, Peter1 aSchwartz, N., E.1 aWolpaw, Jonathan1 aNeuper, C.1 aSellers, E., W. uhttp://www.ncbi.nlm.nih.gov/pubmed/1957409105137nas a2200373 4500008004100000022001400041245007500055210006900130260001200199300001000211490000800221520406800229653001004297653001504307653001004322653001804332653002404350653002704374653001104401653000904412653002404421653002404445653001904469653003604488653004104524653002404565653002804589100001904617700001904636700002404655700001504679700002104694856004804715 2008 eng d a0165-027000aBrain-computer interfaces (BCIs): Detection Instead of Classification.0 aBraincomputer interfaces BCIs Detection Instead of Classificatio c01/2008 a51-620 v1673 a

Many studies over the past two decades have shown that people can use brain signals to convey their intent to a computer through brain-computer interfaces (BCIs). These devices operate by recording signals from the brain and translating these signals into device commands. They can be used by people who are severely paralyzed to communicate without any use of muscle activity. One of the major impediments in translating this novel technology into clinical applications is the current requirement for preliminary analyses to identify the brain signal features best suited for communication. This paper introduces and validates signal detection, which does not require such analysis procedures, as a new concept in BCI signal processing. This detection concept is realized with Gaussian mixture models (GMMs) that are used to model resting brain activity so that any change in relevant brain signals can be detected. It is implemented in a package called SIGFRIED (SIGnal modeling For Real-time Identification and Event Detection). The results indicate that SIGFRIED produces results that are within the range of those achieved using a common analysis strategy that requires preliminary identification of signal features. They indicate that such laborious analysis procedures could be replaced by merely recording brain signals during rest. In summary, this paper demonstrates how SIGFRIED could be used to overcome one of the present impediments to translation of laboratory BCI demonstrations into clinically practical applications.

10aAdult10aAlgorithms10aBrain10aBrain Mapping10aElectrocardiography10aElectroencephalography10aHumans10aMale10aMan-Machine Systems10aNormal Distribution10aOnline Systems10aSignal Detection, Psychological10aSignal Processing, Computer-Assisted10aSoftware Validation10aUser-Computer Interface1 aSchalk, Gerwin1 aBrunner, Peter1 aGerhardt, Lester, A1 aBischof, H1 aWolpaw, Jonathan uhttp://www.ncbi.nlm.nih.gov/pubmed/1792013402677nas a2200421 4500008004100000022001400041245009700055210006900152260001200221300001200233490000700245520147600252653002501728653001201753653003601765653003001801653001401831653001401845653003301859653001401892653002101906653000901927653001501936653001601951653000901967653001701976653002201993653002702015653001602042653003202058100001902090700002102109700001902130700002102149700001802170700001902188856004802207 2008 eng d a0014-298000aInterferon-gamma limits the availability of iron for intramacrophage Salmonella typhimurium.0 aInterferongamma limits the availability of iron for intramacroph c07/2008 a1923-360 v383 a

In stimulating effector functions of mononuclear phagocytes, IFN-gamma is of pivotal importance in host defense against intramacrophage pathogens including salmonellae. As the activity of IFN-gamma is modulated by iron and since a sufficient availability of iron is essential for the growth of pathogens, we investigated the regulatory effects of IFN-gamma on iron homeostasis and immune function in murine macrophages infected with Salmonella typhimurium. In Salmonella-infected phagocytes, IFN-gamma caused a significant reduction of iron uptake via transferrin receptor 1 and resulted in an increased iron efflux caused by an enhanced expression of the iron exporter ferroportin 1. Moreover, the expression of haem oxygenase 1 and of the siderophore-capturing antimicrobial peptide lipocalin 2 was markedly elevated following bacterial invasion, with IFN-gamma exerting a super-inducing effect. This observed regulatory impact of IFN-gamma reduced the intracellular iron pools within infected phagocytes, thus restricting the acquisition of iron by engulfed Salmonella typhimurium while concomitantly promoting NO and TNF-alpha production. Our data suggest that the modulation of crucial pathways of macrophage iron metabolism in response to IFN-gamma concordantly aims at withdrawing iron from intracellular Salmonella and at strengthening macrophage immune response functions. These regulations are thus consistent with the principles of nutritional immunity.

10aAcute-Phase Proteins10aAnimals10aAntimicrobial Cationic Peptides10aCation Transport Proteins10aCell Line10aFerritins10aHeme Oxygenase (Decyclizing)10aHepcidins10aInterferon-gamma10aIron10aLipocalins10aMacrophages10aMice10aNitric Oxide10aOncogene Proteins10aSalmonella typhimurium10aTransferrin10aTumor Necrosis Factor-alpha1 aNairz, Manfred1 aFritsche, Gernot1 aBrunner, Peter1 aTalasz, Heribert1 aHantke, Klaus1 aWeiss, Günter uhttp://www.ncbi.nlm.nih.gov/pubmed/1858132303145nas a2200373 4500008004100000022001400041245005700055210005400112260001200166300001000178490000700188520212100195653001002316653001502326653001802341653002102359653003302380653002702413653001302440653002202453653001102475653001102486653000902497653003502506653003102541653003202572100001902604700001902623700001902642700001702661700002402678700002102702856004802723 2008 eng d a1095-957200aReal-time detection of event-related brain activity.0 aRealtime detection of eventrelated brain activity c11/2008 a245-90 v433 a

The complexity and inter-individual variation of brain signals impedes real-time detection of events in raw signals. To convert these complex signals into results that can be readily understood, current approaches usually apply statistical methods to data from known conditions after all data have been collected. The capability to provide meaningful visualization of complex brain signals without the requirement to initially collect data from all conditions would provide a new tool, essentially a new imaging technique, that would open up new avenues for the study of brain function. Here we show that a new analysis approach, called SIGFRIED, can overcome this serious limitation of current methods. SIGFRIED can visualize brain signal changes without requiring prior data collection from all conditions. This capacity is particularly well suited to applications in which comprehensive prior data collection is impossible or impractical, such as intraoperative localization of cortical function or detection of epileptic seizures.

10aAdult10aAlgorithms10aBrain Mapping10aComputer Systems10aDiagnosis, Computer-Assisted10aElectroencephalography10aEpilepsy10aEvoked Potentials10aFemale10aHumans10aMale10aPattern Recognition, Automated10aReproducibility of Results10aSensitivity and Specificity1 aSchalk, Gerwin1 aLeuthardt, E C1 aBrunner, Peter1 aOjemann, J G1 aGerhardt, Lester, A1 aWolpaw, Jonathan uhttp://www.ncbi.nlm.nih.gov/pubmed/1871854402450nas a2200397 4500008004100000022001400041245010000055210006900155260001200224300001000236490000700246520132400253653001201577653002701589653002401616653001601640653001301656653003101669653001601700653001601716653000901732653001801741653001601759653000901775653002301784653003001807653000801837100001701845700002301862700001901885700002001904700001801924700001901942700001901961856007201980 2005 eng d a0168-827800aPathways for the regulation of body iron homeostasis in response to experimental iron overload.0 aPathways for the regulation of body iron homeostasis in response c10/2005 a711-90 v433 aBACKGROUND/AIMS: Secondary iron overload is a frequent clinical condition found in association with multiple blood transfusions. METHODS: To gain insight into adaptive changes in the expression of iron genes in duodenum, liver and spleen upon experimental iron overload we studied C57BL/6 mice receiving repetitive daily injections of iron-dextran for up to 5 days. RESULTS: Iron initially accumulated in spleen macrophages but with subsequent increase in macrophage ferroportin and ferritin expression its content in the spleen decreased while a progressive storage of iron occurred within hepatocytes which was paralleled by a significant increase in hepcidin and hemojuvelin expression. Under these conditions, iron was still absorbed from the duodenal lumen as divalent metal transporter-1 expressions were high, however, most of the absorbed iron was incorporated into duodenal ferritin, while ferroportin expression drastically decreased and iron transfer to the circulation was reduced. CONCLUSIONS: Experimental iron overload results in iron accumulation in macrophages and later in hepatocytes. In parallel, the transfer of iron from the gut to the circulation is diminished which may be referred to interference of hepcidin with ferroportin mediated iron export, thus preventing body iron accumulation.10aAnimals10aDisease Models, Animal10aDisease Progression10aDNA Primers10aDuodenum10aGene Expression Regulation10aHepatocytes10aHomeostasis10aIron10aIron Overload10aMacrophages10aMice10aMice, Inbred C57BL10aPolymerase Chain Reaction10aRNA1 aTheurl, Igor1 aLudwiczek, Susanne1 aEller, Philipp1 aSeifert, Markus1 aArtner, Erika1 aBrunner, Peter1 aWeiss, Günter uhttp://www.sciencedirect.com/science/article/pii/S0168827805003168#