Computer taught to read letters directly from brain

20 August 2013
By Edd Gent
Mobile version
Share |
Researchers taught a mathematical model to determine what letter a subject was looking at from MRI images of the brain

Researchers taught a mathematical model to determine what letter a subject was looking at from MRI images of the brain

MRI images combined with an elegant mathematical model have allowed researchers to determine which letter a subject is looking at.

Researchers from Radboud University, Netherlands, used data from a functional MRI scanner to determine what a test subject is looking by ‘teaching’ a mathematical model how small volumes of 2x2x2mm from the brain scans – known as voxels – respond to individual pixels.

By combining all the information about the pixels from the voxels, it became possible to reconstruct the image viewed by the subject. The result was not a clear image, but a somewhat fuzzy speckle pattern. In this study, the researchers used hand-written letters.

“After this we did something new,” said lead researcher Marcel van Gerven at the Donders Institute for Brain, Cognition and Behaviour at Radboud. “We gave the model prior knowledge: we taught it what letters look like. This improved the recognition of the letters enormously.

“The model compares the letters to determine which one corresponds most exactly with the speckle image, and then pushes the results of the image towards that letter. The result was the actual letter, a true reconstruction.”

The journal Neuroimage has accepted the article, which will be published soon. A preliminary version of the article can be read online here.

“Our approach is similar to how we believe the brain itself combines prior knowledge with sensory information. For example, you can recognise the lines and curves in this article as letters only after you have learned to read,” said van Gerven.

“And this is exactly what we are looking for: models that show what is happening in the brain in a realistic fashion. We hope to improve the models to such an extent that we can also apply them to the working memory or to subjective experiences such as dreams or visualisations. Reconstructions indicate whether the model you have created approaches reality.”

“In our further research we will be working with a more powerful MRI scanner,” said Sanne Schoenmakers, who is working on a thesis about decoding thoughts.

“Due to the higher resolution of the scanner, we hope to be able to link the model to more detailed images. We are currently linking images of letters to 1200 voxels in the brain; with the more powerful scanner we will link images of faces to 15,000 voxels.”

Latest Issue

E&T cover image 1606

"Where would Frankenstein and his creative mind fit into today's workplace? Should we fear technological developments or embrace them?"

E&T jobs

  • Lecturer in Engineering (Electronic / Electrical)

    Blackburn College
    • Blackburn, Lancashire
    • £23,560 to £35,583 pro-rata, per annum plus Market Premium of £3K per annum

    We are looking for a Lecturer in Electronic / Electrical Engineering to join our busy Higher Education team at a time when the STEM agenda....

    • Recruiter: Blackburn College

    Apply for this job

  • Lecturer in Engineering (Mechanical)

    Blackburn College
    • Blackburn, Lancashire
    • £23,560 to £35,583 pro-rata, per annum; plus Market Premium of £3,000 per annum

    We are looking for a Lecturer in Mechanical Engineering to join our busy Higher Education team at a time when the STEM agenda...

    • Recruiter: Blackburn College

    Apply for this job

  • Director of Technology & Engineering

    Birmingham Metropolitan College
    • Birmingham, West Midlands
    • c £55,000.00

    This key role will provide inspirational leadership to drive success and outstanding performance across the department

    • Recruiter: Birmingham Metropolitan College

    Apply for this job

  • Assistant Professor (Tenure Track) of Smart Building Solutions

    ETH Zurich
    • Zurich, Canton of Zürich (CH)

    The successful candidate is expected to develop a strong and visible research programme in the area of control and diagnostics of building systems

    • Recruiter: ETH Zurich

    Apply for this job

  • Network Innovation Engineer / Analyst - UK Power Sector

    Premium job

    Nortech Management Ltd
    • Birmingham, West Midlands or Pershore (Worcestershire)
    • £30,000 - £35,000 (depending on experience) + benefits

    Network Innovation Engineer / Analyst to join a team of talented technology enthusiasts who design and support the low carbon networks of the future.

    • Recruiter: Nortech Management Ltd

    Apply for this job

  • Production Engineer

    Premium job

    Compact Engineering
    • Thirsk / Leeds / Banbury / Colchester / Cambridge
    • Salary will be competitive and commensurate with experience, knowledge, aptitude and capability

    A Production Engineer with some knowledge and understanding of radiant energy transfer.

    • Recruiter: Compact Engineering

    Apply for this job

  • Electrical Engineer with Strong telecoms background

    Premium job

    Sure South Atlantic Ltd
    • Falkland Islands

    Sure South Atlantic Ltd currently has a unique engineering opportunity in their Falkland Islands office. Surrounded by the Atlantic Ocean, teeming ...

    • Recruiter: Sure South Atlantic Ltd

    Apply for this job

  • Electronics Engineer

    Premium job

    Nikon Metrology Europe
    • Tring, Hertfordshire

    Nikon Metrology is looking for an Electronics Engineer to join our Electronics Team based in Tring (UK).

    • Recruiter: Nikon Metrology Europe

    Apply for this job

  • Cyber, Communication, Information and Data Scientist roles

    Premium job

    Dstl
    • Porton Down, Salisbury
    • Competitive salaries

    Information is everything. Use it to serve your country and help keep us safe.

    • Recruiter: Dstl

    Apply for this job

  • MI Senior Developer

    National Grid
    • Hinckley, England, Leicestershire
    • Negotiable

    MI Senior Developer Hinckley National Grid's energy network transports gas and electricity to homes and businesses all over the UK. It's an essential part of all our lives. And it needs to be continuously advanced and enhanced to meet increasing demand wh

    • Recruiter: National Grid

    Apply for this job

More jobs ▶

Subscribe

Choose the way you would like to access the latest news and developments in your field.

Subscribe to E&T