Brain Scanner Can Tell What You're Looking At 03-05-08 from WIRED

[brain]

Brain Scanner Can Tell What You're Looking At

Brain Scanner Can Tell What You're Looking At
By Brandon Keim

Tell me what you see.

On second thought, don't: A computer will soon be able to do it, simply by analyzing the activity of your brain.

That's the promise of a decoding system unveiled this week in Nature by neuroscientists from the University of California at Berkeley.

The scientists used a functional magnetic resonance imaging machine -- a real-time brain scanner -- to record the mental activity of a person looking at thousands of random pictures: people, animals, landscapes, objects, the stuff of everyday visual life. With those recordings the researchers built a computational model for predicting the mental patterns elicited by looking at any other photograph. When tested with neurological readouts generated by a different set of pictures, the decoder passed with flying colors, identifying the images seen with unprecedented accuracy.

"No one that I know would ever have guessed our decoder would do this well," study co-author Jack Gallant said.

As the decoder is refined, it could be used to explore the phenomenon of visual attention -- concentration on one part of a complicated scene -- and then to illuminate the dimly understood intricacies of the mind's eyes.

"One day it may even be possible to reconstruct the visual content of dreams," Gallant said.

After that, the decoding model could be harnessed for more visionary purposes: early warning systems for neurological diseases or interfaces that allow paralyzed people to engage with the world.

Other uses may not be so noble, such as marketing campaigns crafted for maximum mental penetration or invasions of mental privacy mounted in the name of fighting terrorism and crime.

Those technologies remain decades away, but researchers say it's not too soon to think about them, especially if research progresses at the pace set by this study.

Earlier decoders could only tell whether someone looked at a general type of image -- at a dog, for example -- but couldn't identify more specific photos, such as a small dog eating a bone. They've also been incapable of predicting what thought patterns an image would provoke.

The Berkeley model overcame both those limitations.

"It's quite tedious to measure every possible thought you might encounter, then measure the brain activity for that," said John-Dylan Haynes, a Max Planck Institute neuroscientist who was not involved in the study. "This is a big step forward."

Future steps involve expanding the decoder beyond its current focus on the brain's primary visual cortex, which represents general forms but doesn't handle the more complicated optical information processed in other parts of the brain.

More detail is also required, as the brain scanners used for the study measure blood flow caused by neural activity at a relatively coarse resolution of two cubic millimeters.

A higher-resolution, fully reconstructive decoder could help researchers chart the incredibly complex processes underlying visual perception. Gallant also hopes it could be used to detect early symptoms of neurological diseases like Alzheimer's and Parkinson's.

Eventually, Haynes said, the Berkeley model could be harnessed for something akin to mind reading.

"We want not only to decode people's perceptions, but also high-level mental states: people's intentions, their plans," Haynes said.

But Gallant warned of technological malfeasance. In the courtroom, mental readouts could have the same problems as eyewitness testimony, which is often unreliable and biased even though witnesses believe they're telling the truth.

The allure of reading minds to prove innocence or guilt, Haynes said, could override concerns about mental privacy -- an ethically ambiguous conflict. More obviously dubious is the possible use of mind-reading machines by marketers.

"There's some things we can do, and some we can't," Haynes said. "Some things are very easy, and others are not. But it's vital to think about the ethics now."




Scientists have developed a computer model that predicts the brain patterns elicited by looking at different images -- a possible first step on the path to mind reading.
Image: University of California at Berkeley

[Shelley]

I guess that means that you should be in a good mood, and not worry about how long the test will take. I bet you that if you go and do the test on two successive days in vastly different moods, your scan will be different. Unless of course the test is mind numbingly long.

[brain]

Shelley:

You know what would be cool?
This could eliminate those long
and often boring "neuropsych" tests
and possibility do away with it!

And even more cooler, what the
EEG's doesn't pick up clearly,
these scans would be able to and
possibility give even better hope
in tracking down seizures and
where it's malfunctioning!

However, when I was reading about
the "criminal part" - I'd like to see
it used on OJ Simpson ... *laughs*
to see if HE did it or not ...

[Shelley]

Just cuz he had a clever lawyer, doesn't mean that he was innocent. Remember, it was a year long circus, with the OJ lawyer as the contortionist.

[Bernard]

... I'd like to see
it used on OJ Simpson ... *laughs*
to see if HE did it or not ...

[Birdbomb]

OJ LIED?????




That thing would MELT upon hearing his voice!

[Shelley]

Man, that scare me, in that I have a hard time talking to people and maintaining a conversation. I would be found guilty of whatever they put there mind to.

[brain]

You know ... I started reading about
people in Post-Icky stages (thanks
to simple partial's translation of Post-Ictal)...

NOW that would be interesting how
the Voice / Vocal Analyzer would
analyze our recordings during that
phase. I'm really curious now ...

More curious than a cat with 9 Lives!

[keyna]

It would be interesting, I wonder how it would do. I often lose my voice, or sound like I'm 101 yrs old because of this damn VNS.