Difference between revisions of "Sandbox"

From Computational Memory Lab
Jump to: navigation, search
(Postdoctoral Fellows, Medical Residents, & Graduate Students)
 
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
<big>[https://memory.psych.upenn.edu/InternalWiki/Contact_List Full Contact List] (CML Internal Wiki)</big>
+
__NOTITLE__
 +
__NOTOC__
 +
[[File:CML_Logo.png|center|link=]]
  
<big>[[More Lab Photos]]</big>
 
  
__FORCETOC__
 
__TOC__
 
  
== Lab Directors ==
+
{| border="0" cellpadding="10" style="margin: 0 auto;"
{{Gallery|Mike.jpg|360px|link=Michael J. Kahana|caption=<big>[[Michael J. Kahana|Michael J. Kahana, Ph.D.]]</big><br />kahana AT psych.upenn.edu<br />CML Principal Investigator}}
+
|-
{{Gallery|Dan.jpg|360px|caption=<big>[[Daniel S. Rizzuto|Daniel S. Rizzuto, Ph.D.]]</big><br />drizzuto AT sas.upenn.edu<br />Director of Cognitive Neuromodulation}}
+
|
 +
{| border="0" cellpadding="5" style="border: 1px solid darkgray;"
 +
|-
 +
| [[File:Models-thumb.png|frameless|left|border|150px|link=#Computational models of human memory]]
 +
|-
 +
| width="110pt" | <span style="font-size: 15pt; line-height: 130%">[[#Computational models of human memory|Computational models of human memory]]</span>
 +
|}
 +
|
 +
{| border="0" cellpadding="5" style="border: 1px solid darkgray;"
 +
|-
 +
| [[File:Ecog-thumb.png|frameless|left|border|150px|link=#Neural oscillatory correlates of episodic memory]]
 +
|-
 +
| width="110pt" | <span style="font-size: 15pt; line-height: 130%">[[#Neural oscillatory correlates of episodic memory|Neural oscillatory correlates of episodic memory]]</span>
 +
|}
 +
|
 +
{| border="0" cellpadding="5" style="border: 1px solid darkgray;"
 +
|-
 +
| [[File:MillerThumb.png|frameless|left|border|150px|link=#Human spatial memory and cognition]]
 +
|-
 +
| width="110pt" | <span style="font-size: 15pt; line-height: 130%">[[#Human spatial memory and cognition|Human spatial memory and cognition]]</span>
 +
|}
  
{{End Gallery}}
+
{| border="0" cellpadding="5" style="border: 1px solid darkgray;"
 +
|-
 +
| [[File:LabWiki_RAMFigure.png|frameless|left|border|150px|link=#Cognitive Neuromodulation]]
 +
|-
 +
| width="110pt" | <span style="font-size: 15pt; line-height: 130%">[[#Cognitive Neuromodulation|Cognitive Neuromodulation]]</span>
 +
|}
  
  
== Postdoctoral Fellows, Medical Residents, & Graduate Students ==
 
{{Gallery|Karl.jpg|250px|caption=<big>[http://karlhealey.github.com/Site/Karl_Healey.html Karl Healey, Ph.D.]</big><br />healeym AT sas.upenn.edu<br />Postdoctoral Fellow}}
 
{{Gallery|Youssef.jpg|250px|caption=<big>Youssef Ezzyat, Ph.D.</big><br />yezzyat AT sas.upenn.edu<br />Postdoctoral Fellow }}
 
{{Gallery|Max.jpg|250px|caption=<big>Max Merkow, M.D.</big><br />Maxwell.Merkow AT uphs.upenn.edu<br />Postdoctoral Fellow}}
 
{{Gallery|BryanMoore.JPG|250px||caption=<big>Bryan Moore, M.D.</big><br />bryan.moore AT uphs.upenn.edu<br /> Postdoctoral Fellow}}
 
{{Gallery|Nicole.jpg|250px|caption=<big>[http://sites.google.com/site/nmarielong Nicole Long, Ph.D.]</big><br />niclong AT sas.upenn.edu<br />Postdoctoral Fellow}}
 
{{Gallery|Ashwin.jpg|250px|caption=<big>Ashwin Ramayya, Ph.D.</big><br />ramayya AT mail.med.upenn.edu<br />Neuroscience M.D./Ph.D. Student}}
 
  
 +
{| cellpadding="20" style="margin: 0 auto;"
 +
| width="700pt" | <span style="font-size: 17pt; line-height: 130%">The Computational Memory Lab uses mathematical modeling and computational techniques to study human memory. We apply these quantitative methods both to data from laboratory studies of human memory and from electrophysiological studies involving direct human brain recordings in neurosurgical patients.</span><br /><br /><span style="font-size: 13pt">Our research is focused on neurocomputational mechanisms of human episodic and spatial memory.  Episodic memory refers to memory for events that are embedded in a temporal context. This includes both memory for significant life events and memory for common daily activities. In the laboratory, episodic memory is investigated by presenting lists of items (frequently words) for study, and then asking participants to recall the words. By analyzing the dynamics of the recall process one can quantify the way in which people transition from one recalled word to the next (see Fig. 1). <br /><br />Furthermore, by studying the electrophysiology of the brain while engaged in memory tasks, we can find, for example, regions that show increased or decreased activity when a word is successfully encoded (i.e., later recalled) versus when it is not successfully encoded, known as the ''subsequent memory effect'' (see Fig. 3).<br /><br />Two of our ongoing, large-scale data collection projects are the [[Penn Electrophysiology of Encoding and Retrieval Study]] ([[PEERS]]), a multi-session experiment with young and older adults combining free recall and scalp EEG (a book of these results can be found [http://memory.psych.upenn.edu/files/misc/ALL_ltpFR1_1-20_16-04-2015.pdf here]); and an effort to collect electrophysiological data on patients with intractable epilepsy (undergoing monitoring with intracranial electrodes at partnering local hospitals) while they participate in a variety of memory and decision-making tasks.</span>
 +
|
 +
{| cellpadding="20" style="border: 1px solid darkgray;"
 +
| width="100pt" style="background-color:#dddddd;"| [[File:fhm_cover.png|175px|link=Foundations of Human Memory]]
 +
<big>[[Foundations of Human Memory]]</big><br />by [[Michael J. Kahana]]<br /><br />Please [[Foundations of Human Memory|click here]] for more information and errata.
 +
|}
 +
|}
  
{{End Gallery}}
 
  
== Research Staff ==
+
== Computational models of human memory ==
<gallery widths=225px heights=300px>
+
To explain the processes underlying encoding, organization and retrieval of episodic memories, Kahana and colleagues (notably Marc Howard, Sean Polyn, Per Sederberg, and Lynn Lohnas) have developed a class of retrieved-context models. These models assume that the input to the memory system itself produces contextual drift, and that the current state of context is used to retrieve items from memory. The temporal context model (TCM; [[Publications#HowaKaha02|Howard and Kahana, 2002]]) was introduced to explain recency and contiguity effects in free recall. Specifically, recency effects appear because the context at the time of the memory test is most similar to the context associated with recent items. When an item is retrieved at test, it reinstates the context active when that item was studied. Because this context overlaps with the encoding context of the items' neighbors, a contiguity effect results. Consistent with experimental data, TCM and its variants also predict that recency and contiguity effects are approximately time-scale invariant ([[Publications#SedeEtal08|Sederberg, Howard, and Kahana, 2008]]). [[Publications#PolyEtal09|Polyn, Norman, and Kahana (2009)]] developed the Context Maintenance and Retrieval model (CMR), which is a generalized version of TCM that accounts for the influence of non-temporal associations (e.g., semantic knowledge) on recall dynamics. MATLAB scripts to run the CMR model [[CMR|can be downloaded here]].
File:Katherine.jpg|<big>Katherine Hurley</big><br />kbhurley AT psych.upenn.edu<br />Research Coordinator
+
File:DebG.jpg|<big>Deb Gaspari</big><br />gaspari AT sas.upenn.edu<br />Grants Manager
+
File:Anastasia.jpg|<big>Anastasia Lyalenko</big><br />analy AT psych.upenn.edu<br />Research Specialist
+
File:Deb.jpg|<big>Deborah Levy</big><br />deblevy AT psych.upenn.edu<br />Research Specialist
+
File:Logan.jpg|<big>Logan O'Sullivan</big><br />losu AT psych.upenn.edu<br />Research Specialist
+
File: Sandy.jpg|<big>Sandra LaMonaca</big><br />sandrala AT sas.upenn.edu<br />Assistant to the P.I.
+
File: Wanda1.jpg‎|<big>Paul A. Wanda</big><br />pwanda AT sas.upenn.edu<br />RAM Project Manager
+
</gallery>
+
  
== Software Developers ==
+
Despite the vast stores of memories we accumulate over a lifetime of experience, the human memory system is often able to target just the right information, seemingly effortlessly. How does the memory system accomplish this feat? Most previous models made the simplifying assumption that memory search is automatically restricted to a target list, largely bypassing the need to target the right information. [[Publications#LohnEtal14| Lohnas, Polyn, and Kahana (2015)]] developed CMR2  to address this issue. In CMR2, memory accumulates across multiple experimental lists, and temporal context is used both to focus retrieval on a target list and to censor retrieved information when its match to the current context indicates that it was learned in a non-target list. The model simultaneously accounts for a wide range of intralist and interlist phenomena, including the pattern of prior-list intrusions observed in free recall, build-up of and release from proactive interference, and the ability to selectively target retrieval of items on specific prior lists (Jang & Huber, 2008; Shiffrin, 1970). [[Publications#HealKaha15|Healey and Kahana (2015)]] used CMR2 to better understand why memory tends to get worse as we age. By fitting CMR2 to the performance of individual younger and older adults, they identified deficits in four critical processes: sustaining attention across a study episode, generating retrieval cues, resolving competition, and screening for inaccurate memories (intrusions). Healey and Kahana extended CMR2 to simulate a recognition memory task using the same mechanisms the free recall model uses to reject intrusions. Without fitting any additional parameters, the model accounts for age differences in recognition memory accuracy. Confirming a prediction of the model, free recall intrusion rates correlate positively with recognition false alarm rates. MATLAB scripts to run the CMR2 model [[Publications#LohnEtal14|can be downloaded here]].
<gallery widths=225px heights=300px>
+
File:TomG.jpg|<big>Tom Gradel</big><br />tgradel AT psych.upenn.edu<br />Senior Software Developer
+
File:Isaac.jpg|<big>Isaac Pedisich</big><br />iped AT sas.upenn.edu<br />Software Developer
+
File:Novich.jpg|<big>Corey Novich</big><br /> conovich AT seas.upenn.edu<br />Software Developer
+
</gallery>
+
  
== Undergraduate Students ==
+
{| style="margin: 0 auto;" cellpadding="20"
<gallery widths=150px heights=200px>
+
|[[File:cmr_neuro.png|none|thumb|400px|''Fig. 1:'' '''The context-maintenance and retrieval model.''' A. Schematic of CMR. When an item is studied its feature representation (fi) is activated on F. The feature representation contains both item and source features (e.g., size / animacy judgment). An associative weight matrix (MFC) allows each item to update a context representation that contains the item and source features of recently studied items. During study, the features of each item are associated with coactive context elements. During recall, the context representation reactivates (through MCF) the features of recently studied items. B. Hypothesized interactions between prefrontal cortex, temporal cortex, and medial temporal lobe during memory encoding and retrieval predicted by CMR.]]
<!--File:Jimmy.jpg|<big>James Germi</big><br />
+
|[[File:cmr2_data.png|center|thumb|600px|''click to enlarge''<br /><br />''Fig. 2:'' '''Data and CMR2 Simulations.''' A. This curve shows the probability of making a recall to serial position i+lag immediately following recall of serial position ''i''—that is, the conditional-response probability (CRP) as a function of lag. CMR2 captures older adults' temporal contiguity deficit. B. Release from proactive interference (PI). Participants studied lists of three items, each drawn from the same semantic category. After three lists from the same semantic category, subjects were then presented with a new set of three lists from a different semantic category. Top: Data from Loess (1967), note the scalloped pattern: performance declines across same-category lists and improves when a new category is presented. Bottom: CMR2 simulations capture the release from PI pattern. C. CMR2 simulations of hit and false alarm rates in recognition. D. As predicted by CMR2, recognition false alarm rates correlate with free recall intrusion rates. ]]
<!--File:Alyssa.jpg|<big>Alyssa Johncola</big><br />
+
|}
<!--File:Johanna.jpg|<big>Johanna Phillips</big><br />
+
<!--File:Stamati.jpg|<big>Stamati Liapis</big><br />
+
File:Tanvi.jpg|<big>Tanvi Patel</big><br />
+
<!--File:Omar.jpg|<big>Omar Lopez</big><br />
+
<!--File:QK.jpg|<big>Q Kalantary</big><br />
+
File:ShivaliGovani.jpg|<big>Shivali Govani</big><br />
+
File:TGianangelo.jpg|<big>Taylor Gianangelo</big><br />
+
  
</gallery>
+
== Neural oscillatory correlates of episodic memory ==
  
== Lab Alumni ==
+
We investigate the neurophysiology of episodic memory with electrocorticographic (ECoG) and single neuron recordings from neurosurgical patients who have had electrodes surgically implanted on the cortical surface of the brain or in the medial temporal lobes (including hippocampus) as part of the clinical process of localizing seizure foci. One focus of this research is to determine the oscillatory correlates of successful episodic memory formation and retrieval. Analyses of such recordings have shown that 65 - 95 Hz (gamma) brain oscillations increase while participants are studying words that they will successfully, as opposed to unsuccessfully, recall ([[Publications#SedeEtal03|Sederberg et al., 2003]]; [[Publications#SedeEtal06|Sederberg et al., 2006]]; [[Publications#BurkEtal14|Burke et al., 2014]]; [[Publications#LongEtal14|Long et al., 2014]]; [[Publications#LongKaha14b|Long and Kahana, 2015]]; for a video, click [[HFA_Encoding| here]] ). Gamma activity in hippocampus and neocortex likewise increases prior to successful recall ([[Publications#SedeEtal07|Sederberg et al., 2007]]; [[Publications#LegaEtal11a|Lega et al., 2011]]; [[Publications#BurkEtal14|Burke et al., 2014]]; for a video, click [[HFA_Retrieval| here]] ). The movie below illustrates these findings.  
<gallery widths=100px perrow=7>
+
File:Kelly.jpg| Kelly Addis, Ph.D. <br /> Consultant, <br /> Synygy
+
File:Erin.jpg|Erin Beck<br />M.P.H. Student, Columbia University
+
File:Burke.jpg|[http://sites.google.com/site/johnfredburkememoryresearch/ John Burke, Ph.D.]<br />Resident<br />University of California, San Francisco
+
File:JeremyC.jpg| Jeremy Caplan, Ph.D. <br /> Associate Professor, University of Alberta
+
File:Liz.jpg|Elizabeth Crutchley<br />Lab Manager, <br /> Infant Language Center, University of Pennsylvania
+
File:Patrick.jpg|Patrick Crutchley<br />Senior Application Developer, [http://wwbp.org World Well-Being Project], <br/>University of Pennsylvania
+
File:Orin.jpg| Orin Davis, Ph.D. <br /> Principal Investigator, [http://www.qllab.org/ Quality of Life Laboratory]
+
File:EmilyD.jpg| Emily Dolan <br /> Evaluation Coordinator, VA Puget Sound
+
File:Arne.jpg| Arne Ekstrom, Ph.D. <br /> Assistant Professor, UC Davis
+
File:Gennady.png| Gennady Erlikhman <br /> Postdoctoral Fellow, <br /> University of Nevada, Reno
+
File:JonathanEW.jpg|Jonathan Eskreis-Winkler<br /> Ph.D. Student, University of Chicago
+
File:Travis.png| Travis Gebhardt <br /> Director of Engineering, KAYAK
+
File:Aaron.jpg| Aaron Geller, M.D. <br /> Resident Physician (Neurology), <br /> NYU
+
File:LynneG.png| Lynne Gauthier <br /> Assistant Professor, Ohio State University
+
File:Jeff.jpg|Jeffrey Greenberg<br />Ph.D. Student, University of Ohio
+
File:Haque.jpg|Rafi Haque<br />M.D./Ph.D. Student, Emory University
+
File:Masaki.jpg| Masaki Horii <br /> Systems Engineer <br /> Photo-Sonics, Inc.
+
File:Marc.jpg| Marc Howard, Ph.D. <br /> Associate Professor, <br /> Boston University
+
File:Kylie.jpg| Kylie Hower <br /> Ph.D. Student, <br /> Temple University
+
File:Grace.jpg| Grace Hwang, Ph.D. <br /> Engineer, <br /> Mitre Corporation
+
File:JoshJ.jpg| [http://memory.psych.upenn.edu/~josh Joshua Jacobs, Ph.D.] <br /> Assistant Professor, <br /> Columbia University
+
File:Ilana.jpg| Ilana Jerud, M.D. <br /> Resident Physician (Psychiatry), <br /> Mount Sinai Hospital
+
File:Person-placeholder.png| Pauline T. Johnsen, Ph.D. <br />
+
File:Person-placeholder.png| Brian Kamins
+
File:RogerKhazan.png| Roger Khazan, Ph.D. <br /> Senior Staff, <br /> MIT Lincoln Laboratory
+
File:DanK.jpg| Dan Kimball, Ph.D. <br /> Associate Professor, <br /> University of Oklahoma
+
File:MatthewK.png| Matthew P. Kirschen, M.D., Ph.D. <br /> Resident Physician, <br /> Children's Hospital of Philadelphia
+
File:KrystalK.png| Krystal Klein <br /> Postdoctoral Fellow, <br /> Ohio University
+
File:Igor.jpg| Igor Korolev <br /> D.O./Ph.D. <br /> Michigan State
+
File:Josh.jpg|Josh Kriegel<br />Postbac, <br /> Columbia University
+
File:Joel.jpg|Joel Kuhn<br />Ph.D. Student, <br /> UC San Diego
+
File:Person-placeholder.png| Richard Lawrence <br /> Ph.D. Student, <br /> U.C. Berkley
+
File:Kenton.jpg| Kenton Lee <br /> Ph.D. Student, <br /> University of Washington
+
File:Brad.jpg| Brad Lega, M.D. <br /> Assistant Professor, <br /> UT Southwestern Medical Center
+
File:TimLew.png| Tim Lew <br /> Ph.D. Student, <br /> UC San Diego
+
File:Ningcheng.jpg| Ningcheng (Peter) Li <br /> M.D. Student, <br /> Yale University
+
File:Lynn.jpg|[http://sites.google.com/site/lynnlohnas/ Lynn Lohnas, Ph.D.]<br />Postdoctoral Fellow, NYU
+
File:JeremyM.jpg| [http://www.princeton.edu/~manning3 Jeremy Manning, Ph.D.] <br /> Postdoctoral Fellow, Princeton University
+
File:Yuvi.jpg| Yuvi Masory <br /> Independent consultant
+
File:Jonathan.jpg| Jonathan Miller <br /> Ph.D. Student, <br /> Drexel University
+
File:Matt.jpg| [http://psych.colorado.edu/~mollison/ Matt Mollison] <br /> Ph.D. Student, <br /> University of Colorado at Boulder
+
File:Neal.jpg| Neal Morton <br /> Ph.D. Student, Vanderbilt University
+
File:EhrenNewman.png| Ehren Newman, Ph.D. <br /> Postdoctoral Fellow, <br /> Boston University
+
File:Sean.jpg| [http://www.polyn.com/ Sean Polyn, Ph.D.] <br /> Assistant Professor, <br /> Vanderbilt University
+
File:Person-placeholder.png| Eric Pressman <br /> Usability Group Sr. Team Lead, <br /> MathWorks
+
File:EmilyR.jpg| Emily Rosenberg <br /> Med Student, <br /> Penn State
+
File:Rachel.jpg|Rachel Russell<br /> Research Coordinator <br /> University of Pennsylvania
+
File:Colin.jpg| Colin Sauder <br /> University of Texas
+
File:Person-placeholder.png| Abraham Schneider, Ph.D. <br />
+
File:GregSchwartz.png| Greg Schwartz, Ph.D. <br /> Assistant Professor, <br /> Northwestern University
+
File:Per.jpg| [http://faculty.psy.ohio-state.edu/sederberg/ Per B. Sederberg, Ph.D.] <br /> Assistant Professor, <br /> Ohio State University
+
File:Person-placeholder.png| David Seelig <br /> D.V.M./Ph.D. Student, <br /> University of Pennsylvania
+
File:Misha.jpg| Misha Serruya, M.D., Ph.D. <br /> Assistant Professor, <br /> Jefferson Hospital
+
File:Yevgeniy.jpg| Yevgeniy Sirotin, Ph.D. <br /> Human Factors Scientist, <br /> Scitor Corporation
+
File:Julia.jpg| Julia (Barnathan) Skolnik <br /> Curriculum Specialist, The Franklin Institute
+
File:Jessica.jpg| Jessica Spencer, M.D. <br /> Assistant Professor, <br /> Emory School of Medicine
+
File:Person-placeholder.png| Alec Solway, Ph.D. <br /> Postdoctoral Associate, <br /> The Virginia Tech Carilion School of Medicine and Research Institute
+
File:Vitaly.jpg| Vitaly Terushkin, M.D. <br /> Zitelli and Brodland Skin Cancer Center
+
File:Michele.jpg| Michele Tully Tine, Ph.D. <br /> Assistant Professor, Dartmouth College
+
File:DanUtin.png| Dan Utin <br /> Research Staff, <br /> MIT Lincoln Laboratory
+
File:Marieke.jpg| [http://www.ai.rug.nl/~mkvanvugt/ Marieke van Vugt, Ph.D.] <br /> Assistant Professor, <br /> University of Groningen
+
File:Christoph.jpg| [http://cogsci.info/ Christoph Weidemann, Ph.D.] <br /> Associate Professor, <br /> Swansea University
+
File:Ryan.jpg|Ryan Bailey Williams <br />
+
File:Person-placeholder.png|Robert Yaffe <br /> NINDS
+
File:Kareem.jpg| Kareem Zaghloul, M.D., Ph.D <br /> Clinical faculty, <br /> NINDS
+
File:Franklin.jpg| Franklin Zaromb, Ph.D. <br /> Research Scientist, <br /> ETS
+
</gallery>
+
  
[[Category:People]]
+
{| style="margin: auto; width: 560px" cellpadding="20"; class="wikitable"
 +
|<HTML5video width="560" height="315" autoplay="true" loop="true">FR</HTML5video>
 +
<span style="font-size:90%"> ''Fig. 3:'' '''Free Recall Paradigm''' By using a free recall task in which participants study a list of words, we can measure episodic memory formation by comparing the spectral correlates associated with encoding items that are later recalled (red) or forgotten (blue). We record electroencephalographic (EEG) signals from subdurally implanted electrodes in patients with medically intractable epilepsy. We can extract spectral signals (power of a given frequency) from the raw EEG voltage traces for each item and measure when and where power at particular frequencies changes. Successful memory formation is associated with increases in gamma band (65 - 95 Hz) activity in left lateral temporal lobe, medial temporal lobe, and left prefrontal cortex.  The same analyses can be performed on items during recall to assess when and where memories are retrieved. Successful memory retrieval is associated with increases in gamma band activity in the left neocortex and hippocampus as well as increases in theta band (4 -8 Hz) activity in right temporal lobe. '''  </span>
 +
|}
 +
 
 +
The ability to reinstate this contextual information during memory search has been considered a hallmark of episodic, or event-based, memory. In [[Publications#MannEtal11a|Manning et al., 2011]], we sought to determine whether contextual reinstatement may be observed in electrical signals recorded from the human brain during episodic recall. We examined ECoG activity from 69 neurosurgical patients as they studied and recalled lists of words in a delayed free recall paradigm (Fig. 4A), and computed similarity between the ECoG patterns recorded just prior to each recall with those recorded after the patient had studied each word. We found that, upon recalling a studied word, the recorded patterns of brain activity were not only similar to the patterns observed when the word was studied, but were also similar to the patterns observed during study of neighboring list words, with similarity decreasing reliably with positional distance (Fig. 4C), just as predicted by context reinstatement models of free recall. The degree to which individual patients exhibited this neural signature of contextual reinstatement was correlated with the contiguity effect as seen in Fig. 4D. In this way, the study provides neural evidence for contextual reinstatement in humans.
 +
 
 +
{| style="margin: 0 auto;" cellpadding="20"
 +
|[[File:neuralContext.png|center|thumb|650px|''Fig. 4:'' '''Neural evidence for contextual reinstatement in humans.''' A. After studying a list of 20 words and performing a brief distraction task, a participant recalls as many words as he can remember, in any order. ECoG activity is recorded during each study and recall event. The similarity between the recorded patterns is computed as a function of lag. B. Each dot marks the location of a single electrode [temporal lobe (1,815 electrodes), frontal lobe (1,737 electrodes), parietal lobe (512 electrodes), and occipital lobe (138 electrodes)]. C. Similarity between the activity recorded during recall of a word from serial position ''i'' and study of a word from serial position ''i'' + lag. (Black dot denotes study and recall of the same word, i.e., lag = 0.) D. Participants exhibiting stronger neural signatures of context reinstatement also exhibited more pronounced contiguity effects (as measured by a percentile-based temporal clustering score). (Figure after Manning et al., 2011.)]]
 +
|}
 +
 
 +
== Human spatial memory and cognition ==
 +
 
 +
 
 +
Our lab is also interested in the neural mechanisms underlying human spatial cognition.  In this work, we use virtual reality computer games in which participants learn the locations of landmarks in virtual environments. To download a sample of a YellowCab session, click [http://memory.psych.upenn.edu/files/misc/yc2_movie.mov here].  Using this approach, we have documented the existence and character of the 4-8 Hz theta rhythm in the human brain as participants learned to navigate through complex virtual environments ([[Publications#KahaEtal99b|Kahana et al., 1999]]; [[Publications#CaplEtal01|Caplan et al., 2001]]; [[Publications#CaplEtal03|Caplan et al., 2003]]; [[Publications#EkstEtal05|Ekstrom et al., 2005]]; [[Publications#JacoEtal09|Jacobs et al., 2010a]]).  Recording individual neurons during virtual navigation, we have discovered "place cells" in the human brain. These cells, which are found primarily in the human hippocampus, become active when a given spatial location is being traversed ([[Publications#EkstEtal03|Ekstrom et al., 2003]]). We also identified several other cellular responses during navigation: cells that become active in response to viewing a salient landmark (from any location), cells that become active when searching for a particular goal location (irrespective of location or view), and cells that respond when traveling in a given direction (bearing/heading).
 +
 
 +
[[Publications#JacoEtal10|Jacobs et al. (2010b)]] examined recordings of single-neuron activity from neurosurgical patients playing a virtual-navigation video game. In addition to place cells, which encode the current virtual location, we describe a unique cell type, entorhinal cortex (EC) path cells, the activity of which indicates whether the patient is taking a clockwise or counterclockwise path around the virtual square road. We find that many EC path cells exhibit this directional activity throughout the environment, in contrast to hippocampal neurons, which primarily encode information about specific locations. More broadly, these findings support the hypothesis that EC encodes general properties of the current context (e.g., location or direction) that are used by hippocampus to build unique representations reflecting combinations of these properties.
 +
 
 +
'''Grid cells''' in the entorhinal cortex appear to represent spatial location via a triangular coordinate system. Such cells, which have been identified in rats, bats and monkeys, are believed to support a wide range of spatial behaviors. Recording neuronal activity from neurosurgical patients performing a virtual-navigation task, [[Publications#JacoEtal13|Jacobs et al. (2013)]] identified cells exhibiting grid-like spiking patterns in the human brain, suggesting that humans and simpler animals rely on homologous spatial-coding schemes.
 +
 
 +
Theories of episodic memory suggest that memory encoding and retrieval are facilitated by '''spatiotemporal context''': a continually updated representation of location in space and time. Recent work in the lab sought to examine the role of spatial context in human episodic memory retrieval through a hybrid spatial and episodic memory task. [[Publications#MillEtal13.pdf|Miller et al. (2013)]] identified place cells as neurosurgical patients performed a delivery task which required them to deliver items to different stores in a virtual town. Following this navigation task, patients were asked to freely recall the items they had delivered. Place cell activation patterns during the navigational task were then compared to the subsequent activation patterns that occurred during the free recall task. Miller et al. found that neural activity during the retrieval of each delivered item was similar to the neural activity associated with the location where that item was encoded. These findings demonstrate context-specific reinstatement of place-responsive cell activity at the time of recall, supporting theories that implicate contextual reinstatement as the basis for memory retrieval.
 +
 
 +
{| style="margin: 0 auto;" cellpadding="20"
 +
[[File:MillerF2.png|center|thumb|225px|''Fig. 5:'' '''Place responsive cells.''' (a) Firing-rate maps for a cell responsive to northward traversals located in the hippocampus of one of the participants. (b) A cell responsive to eastward traversals recorded from a participant's entorhinal cortex. (c) Regional distribution of place-responsive cells across the entire data set of 371 single units (H, hippocampus; A, amygdala; EC, entorhinal cortex; PHG, parahippocampal gyrus; Ant, anterior medial temporal lobe).]]
 +
|[[File:MillerF3.png|right|thumb|800px|''Fig. 6:'' '''Spatial context reinstatement.''' (a) Time courses of neural similarity between ensemble place-cell activity during navigation and during item recall for near, middle, and far spatial distance bins. Shaded regions indicate SEM across recalled items, the horizontal bars indicate statistically significant time points and the vertical dotted line indicates the onset of vocalization. (b) Average neural similarity for near, middle and far distance bins for the time period of -300 to 700ms relative to recall onset. Error bars indicate SEM across recalled items. (c) Neural similarity for near and far spatial distance bins for each participants (colored lines) and the participant average (black line) during -300 to 700ms relative to recall onset. Error bars indicate SEM across participants.]]
 +
|}
 +
 
 +
<!--{| style="margin: 0 auto;" cellpadding="20"
 +
| [[File:grid_1.png|center|thumb|313px|''Fig. 8:'' '''Virtual navigation task.''' (a) Participant’s view of the experiment. (b) Mean duration of successive deliveries in the task, averaged across consecutive pairs of deliveries. (c) Mean excess path length. VRU is a measure of virtual distance. Error shading denotes 95% confidence intervals.]] || [[File:grid_2.png|center|thumb|399px|''Fig. 9:'' The activity of two example grid-like cells. Left, overhead view of the environment, with color representing the firing rate (in Hz) at each virtual location. Middle, two-dimensional autocorrelation of the cell’s activity. Peaks in the autocorrelation function determined the spacing and angle of the fitted c grid, which was then used to plot the estimated grid peaks (white ×) across the entire environment. Right, cell spike waveform; red denotes mean.]]-->
 +
 
 +
<!-- {| style="margin: 0 auto;" cellpadding="20"
 +
| [[File:path_task.png|center|thumb|375px|''Fig. 8:'' '''The Yellow Cab virtual-navigation video game.''' (A) A patient’s on- screen view of the environment during the game. (B) Overhead map of the environment. Possible destination stores are brightly colored and outlined in red. Pale-colored buildings form the remainder of the outer and inner walls of the environment.]] || [[File:path_regions.png|center|thumb|230px|''Fig. 9:'' '''Regional distribution of path cells.''' Bars depict percentage of neurons observed in each brain area that were path cells. Dark shading indicates clockwise or counterclockwise path cells; light shading indicates complex path cells. Region key: A, amygdala; Cx, parietal and temporal cortices; EC, entorhinal cortex; Fr, Frontal cortices; H, hippocampus; PHG, parahippocampal gyrus.]]
 +
|-
 +
|colspan="2"| [[File:pathcell.png|center|thumb|650px|''Fig. 10:'' '''Clockwise and counterclockwise path cell activity.''' Firing rate of a clockwise path cell from a single patient's right entorhinal cortex during one testing session. Panel 1: Mean firing rate during clockwise movement at each location in the virtual environment. Color indicates the mean firing rate (in Hz), and gray lines indicate the path of the patient. Panel 2: Neuronal activity during counterclockwise movements. Panel 3: Indication of whether firing rate at each location was statistically greater (rank-sum test) during clockwise movements (red) or during counterclockwise movements (blue). Panel 4: Firing rate of this neuron combined across all regions of the environment for clockwise ("CW") and counterclockwise ("CCW") movements during straight movements and turns ("Turn"). Panel 4 inset: Activity of a neuron recorded from this same microelectrode in a different testing session; the two cells have very different firing rates and thus are likely distinct, nearby neurons.  (Figure from Jacobs et al., 2010b.)]]
 +
|} -->
 +
 
 +
<!--[[File:grid_cover.gif|thumb|250px|"Jacobs ''et al.'' show the first direct recordings of putative grid cells in the human entorhinal cortex during virtual navigation. Each of these cells supports spatial navigation by activating at a set of locations arranged in a triangular grid across an environment. Cover illustration by Brian Jacobs based on data from a human grid cell and a photograph by Joshua Jacobs." (''Nature'': [http://www.nature.com/neuro/journal/v16/n9/covers/index.html "About the cover"])]]-->
 +
 
 +
== Cognitive Neuromodulation ==
 +
 
 +
The lab is also interested in how electrical stimulation can be used to therapeutically modulate memory function. The [[RAM|RAM]] project, supported by the Defense Advanced Research Projects Agency (DARPA), is a large-scale collaboration in which we use intracranial recording and stimulation to understand and affect memory function. By aggregating data collection from intracranial patients at many clinical centers, we are able to study in detail the neural mechanisms of memory encoding and retrieval across four tasks that address many core memory processes: free recall, categorized free recall, paired associate learning and spatial navigation. During performance of these tasks, we apply targeted electrical stimulation to specific nodes in the memory network, including the hippocampus, medial temporal lobe cortices and the frontal cortex. We then use multivariate machine learning methods to analyze the effects of stimulation on brain activity, and their relationship to memory performance. Our ultimate goal is to use this knowledge to understand how electrical stimulation can be used to treat memory dysfunction.
 +
 
 +
{| style="margin: 0 auto;" cellpadding="20"
 +
[[File:LabWiki_RAMFigure.png|center|thumb|800px|''Figure 7:'' '''Free recall and machine learning for cognitive neuromodulation.''' Left: an example free recall task used to collect record-only and stimulation data in intracranial patients. Right: we use machine learning methods, including classification of brain-wide spectral power, to understand how stimulation can evoke patterns of brain activity likely to lead to either remembering or forgetting.]]
 +
 
 +
[[Category:public]]

Latest revision as of 20:46, 9 February 2016


CML Logo.png


Models-thumb.png
Computational models of human memory
Ecog-thumb.png
Neural oscillatory correlates of episodic memory
MillerThumb.png
Human spatial memory and cognition
LabWiki RAMFigure.png
Cognitive Neuromodulation


The Computational Memory Lab uses mathematical modeling and computational techniques to study human memory. We apply these quantitative methods both to data from laboratory studies of human memory and from electrophysiological studies involving direct human brain recordings in neurosurgical patients.

Our research is focused on neurocomputational mechanisms of human episodic and spatial memory. Episodic memory refers to memory for events that are embedded in a temporal context. This includes both memory for significant life events and memory for common daily activities. In the laboratory, episodic memory is investigated by presenting lists of items (frequently words) for study, and then asking participants to recall the words. By analyzing the dynamics of the recall process one can quantify the way in which people transition from one recalled word to the next (see Fig. 1).

Furthermore, by studying the electrophysiology of the brain while engaged in memory tasks, we can find, for example, regions that show increased or decreased activity when a word is successfully encoded (i.e., later recalled) versus when it is not successfully encoded, known as the subsequent memory effect (see Fig. 3).

Two of our ongoing, large-scale data collection projects are the Penn Electrophysiology of Encoding and Retrieval Study (PEERS), a multi-session experiment with young and older adults combining free recall and scalp EEG (a book of these results can be found here); and an effort to collect electrophysiological data on patients with intractable epilepsy (undergoing monitoring with intracranial electrodes at partnering local hospitals) while they participate in a variety of memory and decision-making tasks.
Fhm cover.png

Foundations of Human Memory
by Michael J. Kahana

Please click here for more information and errata.


Computational models of human memory

To explain the processes underlying encoding, organization and retrieval of episodic memories, Kahana and colleagues (notably Marc Howard, Sean Polyn, Per Sederberg, and Lynn Lohnas) have developed a class of retrieved-context models. These models assume that the input to the memory system itself produces contextual drift, and that the current state of context is used to retrieve items from memory. The temporal context model (TCM; Howard and Kahana, 2002) was introduced to explain recency and contiguity effects in free recall. Specifically, recency effects appear because the context at the time of the memory test is most similar to the context associated with recent items. When an item is retrieved at test, it reinstates the context active when that item was studied. Because this context overlaps with the encoding context of the items' neighbors, a contiguity effect results. Consistent with experimental data, TCM and its variants also predict that recency and contiguity effects are approximately time-scale invariant (Sederberg, Howard, and Kahana, 2008). Polyn, Norman, and Kahana (2009) developed the Context Maintenance and Retrieval model (CMR), which is a generalized version of TCM that accounts for the influence of non-temporal associations (e.g., semantic knowledge) on recall dynamics. MATLAB scripts to run the CMR model can be downloaded here.

Despite the vast stores of memories we accumulate over a lifetime of experience, the human memory system is often able to target just the right information, seemingly effortlessly. How does the memory system accomplish this feat? Most previous models made the simplifying assumption that memory search is automatically restricted to a target list, largely bypassing the need to target the right information. Lohnas, Polyn, and Kahana (2015) developed CMR2 to address this issue. In CMR2, memory accumulates across multiple experimental lists, and temporal context is used both to focus retrieval on a target list and to censor retrieved information when its match to the current context indicates that it was learned in a non-target list. The model simultaneously accounts for a wide range of intralist and interlist phenomena, including the pattern of prior-list intrusions observed in free recall, build-up of and release from proactive interference, and the ability to selectively target retrieval of items on specific prior lists (Jang & Huber, 2008; Shiffrin, 1970). Healey and Kahana (2015) used CMR2 to better understand why memory tends to get worse as we age. By fitting CMR2 to the performance of individual younger and older adults, they identified deficits in four critical processes: sustaining attention across a study episode, generating retrieval cues, resolving competition, and screening for inaccurate memories (intrusions). Healey and Kahana extended CMR2 to simulate a recognition memory task using the same mechanisms the free recall model uses to reject intrusions. Without fitting any additional parameters, the model accounts for age differences in recognition memory accuracy. Confirming a prediction of the model, free recall intrusion rates correlate positively with recognition false alarm rates. MATLAB scripts to run the CMR2 model can be downloaded here.

Fig. 1: The context-maintenance and retrieval model. A. Schematic of CMR. When an item is studied its feature representation (fi) is activated on F. The feature representation contains both item and source features (e.g., size / animacy judgment). An associative weight matrix (MFC) allows each item to update a context representation that contains the item and source features of recently studied items. During study, the features of each item are associated with coactive context elements. During recall, the context representation reactivates (through MCF) the features of recently studied items. B. Hypothesized interactions between prefrontal cortex, temporal cortex, and medial temporal lobe during memory encoding and retrieval predicted by CMR.
click to enlarge

Fig. 2: Data and CMR2 Simulations. A. This curve shows the probability of making a recall to serial position i+lag immediately following recall of serial position i—that is, the conditional-response probability (CRP) as a function of lag. CMR2 captures older adults' temporal contiguity deficit. B. Release from proactive interference (PI). Participants studied lists of three items, each drawn from the same semantic category. After three lists from the same semantic category, subjects were then presented with a new set of three lists from a different semantic category. Top: Data from Loess (1967), note the scalloped pattern: performance declines across same-category lists and improves when a new category is presented. Bottom: CMR2 simulations capture the release from PI pattern. C. CMR2 simulations of hit and false alarm rates in recognition. D. As predicted by CMR2, recognition false alarm rates correlate with free recall intrusion rates.

Neural oscillatory correlates of episodic memory

We investigate the neurophysiology of episodic memory with electrocorticographic (ECoG) and single neuron recordings from neurosurgical patients who have had electrodes surgically implanted on the cortical surface of the brain or in the medial temporal lobes (including hippocampus) as part of the clinical process of localizing seizure foci. One focus of this research is to determine the oscillatory correlates of successful episodic memory formation and retrieval. Analyses of such recordings have shown that 65 - 95 Hz (gamma) brain oscillations increase while participants are studying words that they will successfully, as opposed to unsuccessfully, recall (Sederberg et al., 2003; Sederberg et al., 2006; Burke et al., 2014; Long et al., 2014; Long and Kahana, 2015; for a video, click here ). Gamma activity in hippocampus and neocortex likewise increases prior to successful recall (Sederberg et al., 2007; Lega et al., 2011; Burke et al., 2014; for a video, click here ). The movie below illustrates these findings.

Fig. 3: Free Recall Paradigm By using a free recall task in which participants study a list of words, we can measure episodic memory formation by comparing the spectral correlates associated with encoding items that are later recalled (red) or forgotten (blue). We record electroencephalographic (EEG) signals from subdurally implanted electrodes in patients with medically intractable epilepsy. We can extract spectral signals (power of a given frequency) from the raw EEG voltage traces for each item and measure when and where power at particular frequencies changes. Successful memory formation is associated with increases in gamma band (65 - 95 Hz) activity in left lateral temporal lobe, medial temporal lobe, and left prefrontal cortex. The same analyses can be performed on items during recall to assess when and where memories are retrieved. Successful memory retrieval is associated with increases in gamma band activity in the left neocortex and hippocampus as well as increases in theta band (4 -8 Hz) activity in right temporal lobe.

The ability to reinstate this contextual information during memory search has been considered a hallmark of episodic, or event-based, memory. In Manning et al., 2011, we sought to determine whether contextual reinstatement may be observed in electrical signals recorded from the human brain during episodic recall. We examined ECoG activity from 69 neurosurgical patients as they studied and recalled lists of words in a delayed free recall paradigm (Fig. 4A), and computed similarity between the ECoG patterns recorded just prior to each recall with those recorded after the patient had studied each word. We found that, upon recalling a studied word, the recorded patterns of brain activity were not only similar to the patterns observed when the word was studied, but were also similar to the patterns observed during study of neighboring list words, with similarity decreasing reliably with positional distance (Fig. 4C), just as predicted by context reinstatement models of free recall. The degree to which individual patients exhibited this neural signature of contextual reinstatement was correlated with the contiguity effect as seen in Fig. 4D. In this way, the study provides neural evidence for contextual reinstatement in humans.

Fig. 4: Neural evidence for contextual reinstatement in humans. A. After studying a list of 20 words and performing a brief distraction task, a participant recalls as many words as he can remember, in any order. ECoG activity is recorded during each study and recall event. The similarity between the recorded patterns is computed as a function of lag. B. Each dot marks the location of a single electrode [temporal lobe (1,815 electrodes), frontal lobe (1,737 electrodes), parietal lobe (512 electrodes), and occipital lobe (138 electrodes)]. C. Similarity between the activity recorded during recall of a word from serial position i and study of a word from serial position i + lag. (Black dot denotes study and recall of the same word, i.e., lag = 0.) D. Participants exhibiting stronger neural signatures of context reinstatement also exhibited more pronounced contiguity effects (as measured by a percentile-based temporal clustering score). (Figure after Manning et al., 2011.)

Human spatial memory and cognition

Our lab is also interested in the neural mechanisms underlying human spatial cognition. In this work, we use virtual reality computer games in which participants learn the locations of landmarks in virtual environments. To download a sample of a YellowCab session, click here. Using this approach, we have documented the existence and character of the 4-8 Hz theta rhythm in the human brain as participants learned to navigate through complex virtual environments (Kahana et al., 1999; Caplan et al., 2001; Caplan et al., 2003; Ekstrom et al., 2005; Jacobs et al., 2010a). Recording individual neurons during virtual navigation, we have discovered "place cells" in the human brain. These cells, which are found primarily in the human hippocampus, become active when a given spatial location is being traversed (Ekstrom et al., 2003). We also identified several other cellular responses during navigation: cells that become active in response to viewing a salient landmark (from any location), cells that become active when searching for a particular goal location (irrespective of location or view), and cells that respond when traveling in a given direction (bearing/heading).

Jacobs et al. (2010b) examined recordings of single-neuron activity from neurosurgical patients playing a virtual-navigation video game. In addition to place cells, which encode the current virtual location, we describe a unique cell type, entorhinal cortex (EC) path cells, the activity of which indicates whether the patient is taking a clockwise or counterclockwise path around the virtual square road. We find that many EC path cells exhibit this directional activity throughout the environment, in contrast to hippocampal neurons, which primarily encode information about specific locations. More broadly, these findings support the hypothesis that EC encodes general properties of the current context (e.g., location or direction) that are used by hippocampus to build unique representations reflecting combinations of these properties.

Grid cells in the entorhinal cortex appear to represent spatial location via a triangular coordinate system. Such cells, which have been identified in rats, bats and monkeys, are believed to support a wide range of spatial behaviors. Recording neuronal activity from neurosurgical patients performing a virtual-navigation task, Jacobs et al. (2013) identified cells exhibiting grid-like spiking patterns in the human brain, suggesting that humans and simpler animals rely on homologous spatial-coding schemes.

Theories of episodic memory suggest that memory encoding and retrieval are facilitated by spatiotemporal context: a continually updated representation of location in space and time. Recent work in the lab sought to examine the role of spatial context in human episodic memory retrieval through a hybrid spatial and episodic memory task. Miller et al. (2013) identified place cells as neurosurgical patients performed a delivery task which required them to deliver items to different stores in a virtual town. Following this navigation task, patients were asked to freely recall the items they had delivered. Place cell activation patterns during the navigational task were then compared to the subsequent activation patterns that occurred during the free recall task. Miller et al. found that neural activity during the retrieval of each delivered item was similar to the neural activity associated with the location where that item was encoded. These findings demonstrate context-specific reinstatement of place-responsive cell activity at the time of recall, supporting theories that implicate contextual reinstatement as the basis for memory retrieval.

Fig. 5: Place responsive cells. (a) Firing-rate maps for a cell responsive to northward traversals located in the hippocampus of one of the participants. (b) A cell responsive to eastward traversals recorded from a participant's entorhinal cortex. (c) Regional distribution of place-responsive cells across the entire data set of 371 single units (H, hippocampus; A, amygdala; EC, entorhinal cortex; PHG, parahippocampal gyrus; Ant, anterior medial temporal lobe).
Fig. 6: Spatial context reinstatement. (a) Time courses of neural similarity between ensemble place-cell activity during navigation and during item recall for near, middle, and far spatial distance bins. Shaded regions indicate SEM across recalled items, the horizontal bars indicate statistically significant time points and the vertical dotted line indicates the onset of vocalization. (b) Average neural similarity for near, middle and far distance bins for the time period of -300 to 700ms relative to recall onset. Error bars indicate SEM across recalled items. (c) Neural similarity for near and far spatial distance bins for each participants (colored lines) and the participant average (black line) during -300 to 700ms relative to recall onset. Error bars indicate SEM across participants.



Cognitive Neuromodulation

The lab is also interested in how electrical stimulation can be used to therapeutically modulate memory function. The RAM project, supported by the Defense Advanced Research Projects Agency (DARPA), is a large-scale collaboration in which we use intracranial recording and stimulation to understand and affect memory function. By aggregating data collection from intracranial patients at many clinical centers, we are able to study in detail the neural mechanisms of memory encoding and retrieval across four tasks that address many core memory processes: free recall, categorized free recall, paired associate learning and spatial navigation. During performance of these tasks, we apply targeted electrical stimulation to specific nodes in the memory network, including the hippocampus, medial temporal lobe cortices and the frontal cortex. We then use multivariate machine learning methods to analyze the effects of stimulation on brain activity, and their relationship to memory performance. Our ultimate goal is to use this knowledge to understand how electrical stimulation can be used to treat memory dysfunction.

Figure 7: Free recall and machine learning for cognitive neuromodulation. Left: an example free recall task used to collect record-only and stimulation data in intracranial patients. Right: we use machine learning methods, including classification of brain-wide spectral power, to understand how stimulation can evoke patterns of brain activity likely to lead to either remembering or forgetting.