Mind Reading for Cognitive Systems
Yong-Ho Lee
Center for Brain & Cognitive Research
Korea Research Institute of Standards and Science
Center for Brain and Cognitive Science
Cognitive system in FP6
Artificial Cognitive System
Cogno-
Human Cognitive System
Natural
Cognition
http://kr.blog.yahoo.com/ekdrn
Computing,
Sensing,
Imaging
Info-
ACS
Natural & Life
Sciences,
Neuroscience
BioACS: Artificial Cognitive System
Center for Brain and Cognitive Science
What is a cognitive system?
“Cognitive systems are natural or artificial
information processing systems,
including those responsible for perception,
learning, reasoning and decision making and
for communication and action.”
- Foresight Cognitive Systems Project-
Center for Brain and Cognitive Science
Foresight Cognitive Systems Project

Self-organization in the nervous system







1014 connections between 1010 neurons in neo-cortex
Human computers : 1012 processors
Sensory processing : sight, hearing, touch and so on
Social cognition
Interaction, Planning and Motivation
Memory, Reasoning and Learning
Advanced Neuroscience Technologies
Center for Brain and Cognitive Science
Mind reading
Interface & Interaction
Information
Brain signals or Biological signals
Center for Brain and Cognitive Science
Brain reading tools?
Imaging tools
Metabolism
fMRI
PET
NIRS
Electrophysiology
MEG
ECoG
EEG
Center for Brain and Cognitive Science
Windows to the Brain
Cognitive process : Changes of brain activity in time and space
Electric activity
Metabolic change
Center for Brain and Cognitive Science
Functional MRI
High-field MRI
Imaging of hemodynamic change
+ High spatial resolution
- Poor temporal resolution
Most common device for brain study
Center for Brain and Cognitive Science
Different activation area in the brain
In viewing pictures of different categories (face, house, and painting)
fMRI
Maël Lebreton et al, Neuron (2009)
Center for Brain and Cognitive Science
NIRS : Near InfraRed Spectroscopy
Near IR
Scattered
Skin
Hemoglobin
Brain
Blood vessel
Dong-il SHIMADZU Corp.
Center for Brain and Cognitive Science
NIRS signals
Absorption spectrum of Hemoglobin
3
Relative change of Hb
Oxy Hb Total Hb
deoxy Hb
Deoxy Hb
分子吸光係数
2.5
2
780nm, 805nm, 830nm
oxy Hb
Oxy Hb
Deoxy Hb
1.5
1
Task
Task
Task
0.5
0
650
750
850
可視光　近赤外光
Near IR
950
nm
Finger tapping task
Dong-il SHIMADZU Corp.
Center for Brain and Cognitive Science
Electroencephalography
EEG HydroCel Geodesic Sensor
http://www.egi.com/clinical-division-clinical-products/c-gsh
Source localization
Besa, MEGIS Software GmbH
Susceptive to electric conductivity inhomogeneity of the brain
Center for Brain and Cognitive Science
MEG (Magnetoencephalography)
MEG System
Localization of active currents
+ High temporal resolution
+ Measure neural current
+ Moderate spatial resolution
- Need inverse problem process
- Poor sensitivity to deep sources
Center for Brain and Cognitive Science
Temporal resolution : Role of MEG
Timing of human cortical functions during cognition
Brain: Real time processor in ms time scale
►EEG, MEG-non invasive information with high temporal resolution
Center for Brain and Cognitive Science
Direct Imaging of Neural Current
- Simultaneous imaging of neural current & anatomical structure
- Measurement field : ~ μT
- Nuclear magnetic resonance frequency = ~ Neural activity frequency
- Imaging of neural current distribution
Imaging of neural activity
Center for Brain and Cognitive Science
Direct Imaging of Neural Current
Magnetically shielded room
RF shielding
FLL circuits
Controller
Insert
SQUID
Data acquisition system
Dewar
Filter/Amp
Signal processing
Source analysis
Stimulus
control
Stimulus
Bp
Controlled
current source
Bm
Gradient fields
Center for Brain and Cognitive Science
New MRI : MRI at microTesla field
Ultra-low field MRI
Center for Brain and Cognitive Science
Mind reading device - Molintent
<Camera and Sensor system>
Biological signals
- Heart rate
- Respiration rate
- Face temperature
http://article.joins.com/article/photo/article.asp?Total_ID=3311491&p_cat=life
Center for Brain and Cognitive Science
Application of Mind Reading
Game : Connecting Your Brain to the Game
Neuromarketing
http://www.emotiv.com/
Brain-Computer Interface
Lie Detection
Preference Survey
…
http://www.neurosciencemarketing.com/
Center for Brain and Cognitive Science
Brain-Machine Interface
Control of a Robot Arm by Human Thought Alone
<fMRI image>
<Control of Robot Arm>
<Pattern analysis>
http://www.studybusiness.com/HTML/TRM/02173-06-2006-TRM-11-K.htm
Center for Brain and Cognitive Science
Brain-Machine Interface
Control of a Robot by Human Thought Alone
EEG + NIRS
Matching accuracy > 90%
http://www.youtube.com/watch?v=O6yI_4FHSKI
Center for Brain and Cognitive Science
Summary
Mind Reading :

Until now, reading of only simple thought is possible

Both temporal and spatial resolution are important

Neural current vs. Metabolic change
Golden standard method to be used as the reference for brain
activation patterns when several imaging modalities are
combined?
Ethic issue


Center for Brain and Cognitive Science