Yong-Ho Lee

Mind Reading for Cognitive Systems Yong-Ho Lee Center for Brain & Cognitive Research Korea Research Institute of Standards and Science

Center for Brain and Cognitive Science

Cognitive system in FP6 Artificial Cognitive System

Cogno-

Human Cognitive System

Natural Cognition

http://kr.blog.yahoo.com/ekdrn

Computing, Sensing, Imaging

Info-

ACS Natural & Life Sciences, Neuroscience

BioACS: Artificial Cognitive System Center for Brain and Cognitive Science

What is a cognitive system? “Cognitive systems are natural or artificial information processing systems, including those responsible for perception, learning, reasoning and decision making and for communication and action.” - Foresight Cognitive Systems Project-

Center for Brain and Cognitive Science

Foresight Cognitive Systems Project 

Self-organization in the nervous system 

     

1014 connections between 1010 neurons in neo-cortex

Human computers : 1012 processors Sensory processing : sight, hearing, touch and so on Social cognition Interaction, Planning and Motivation Memory, Reasoning and Learning Advanced Neuroscience Technologies

Center for Brain and Cognitive Science

Mind reading Interface & Interaction

Information

Brain signals or Biological signals

Center for Brain and Cognitive Science

Brain reading tools? Imaging tools Metabolism

fMRI

PET

NIRS

Electrophysiology MEG

ECoG

EEG

Center for Brain and Cognitive Science

Windows to the Brain Cognitive process : Changes of brain activity in time and space

Electric activity Metabolic change

Center for Brain and Cognitive Science

Functional MRI

High-field MRI

Imaging of hemodynamic change

+ High spatial resolution - Poor temporal resolution Most common device for brain study

Center for Brain and Cognitive Science

Different activation area in the brain In viewing pictures of different categories (face, house, and painting) fMRI

Maël Lebreton et al, Neuron (2009)

Center for Brain and Cognitive Science

NIRS : Near InfraRed Spectroscopy

Near IR

Scattered

Skin Hemoglobin Brain Blood vessel Dong-il SHIMADZU Corp.

Center for Brain and Cognitive Science

NIRS signals Absorption spectrum of Hemoglobin 3

Relative change of Hb

Oxy Hb Total Hb

deoxy Hb

Deoxy Hb

分子吸光係数

2.5 2

780nm, 805nm, 830nm oxy Hb

Oxy Hb

Deoxy Hb

1.5 1

Task

Task

Task

0.5 0 650 750 850 可視光　 　 　 　 　 近赤外光

Near IR

950

nm

Finger tapping task Dong-il SHIMADZU Corp.

Center for Brain and Cognitive Science

Electroencephalography EEG HydroCel Geodesic Sensor

http://www.egi.com/clinical-division-clinical-products/c-gsh

Source localization

Besa, MEGIS Software GmbH

Susceptive to electric conductivity inhomogeneity of the brain Center for Brain and Cognitive Science

MEG (Magnetoencephalography) MEG System

Localization of active currents

+ High temporal resolution + Measure neural current + Moderate spatial resolution - Need inverse problem process - Poor sensitivity to deep sources

Center for Brain and Cognitive Science

Temporal resolution : Role of MEG Timing of human cortical functions during cognition Brain: Real time processor in ms time scale

►EEG, MEG-non invasive information with high temporal resolution Center for Brain and Cognitive Science

Direct Imaging of Neural Current - Simultaneous imaging of neural current & anatomical structure - Measurement field : ~ μT - Nuclear magnetic resonance frequency = ~ Neural activity frequency - Imaging of neural current distribution

Imaging of neural activity

Center for Brain and Cognitive Science

Direct Imaging of Neural Current Magnetically shielded room RF shielding

FLL circuits

Controller

Insert SQUID

Data acquisition system

Dewar

Filter/Amp

Signal processing Source analysis

Stimulus control Stimulus Bp Controlled current source

Bm Gradient fields

Center for Brain and Cognitive Science

New MRI : MRI at microTesla field

Ultra-low field MRI

Center for Brain and Cognitive Science

Mind reading device - Molintent

Biological signals - Heart rate - Respiration rate - Face temperature

http://article.joins.com/article/photo/article.asp?Total_ID=3311491&p_cat=life

Center for Brain and Cognitive Science

Application of Mind Reading Game : Connecting Your Brain to the Game

Neuromarketing http://www.emotiv.com/

Brain-Computer Interface Lie Detection Preference Survey … http://www.neurosciencemarketing.com/

Center for Brain and Cognitive Science

Brain-Machine Interface Control of a Robot Arm by Human Thought Alone



http://www.studybusiness.com/HTML/TRM/02173-06-2006-TRM-11-K.htm

Center for Brain and Cognitive Science

Brain-Machine Interface Control of a Robot by Human Thought Alone

EEG + NIRS

Matching accuracy > 90%

http://www.youtube.com/watch?v=O6yI_4FHSKI

Center for Brain and Cognitive Science

Summary Mind Reading : 

Until now, reading of only simple thought is possible



Both temporal and spatial resolution are important



Neural current vs. Metabolic change Golden standard method to be used as the reference for brain activation patterns when several imaging modalities are combined? Ethic issue





Center for Brain and Cognitive Science