Virtual talking head can express human emotions

19 March 2013
By Edd Gent
Mobile version
Share |
Research Engineer Dr Vincent Wan, from Toshiba Research in Cambridge, alongside the digital talking head named Zoe by researchers

Research Engineer Dr Vincent Wan, from Toshiba Research in Cambridge, alongside the digital talking head named Zoe by researchers

Image showing the digital architecture behind Zoe's face (CREDIT: University of Cambridge / Toshiba Cambridge Research Lab)

Image showing the digital architecture behind Zoe's face (CREDIT: University of Cambridge / Toshiba Cambridge Research Lab)

A virtual talking head created by scientists in Cambridge can express human emotion.

The new system, called Zoe, can recite text while realistically recreating emotions like happiness, anger and fear and could see the creation of life-like computerised personal assistants, similar to those seen in sci-fi films.

According to its designers, it is the most expressive controllable avatar ever and students have already remarked upon the similarity with the disembodied head and Holly, the ship's computer, in cult comedy Red Dwarf.

Developed by Toshiba's Cambridge Research Lab and the University of Cambridge's Department of Engineering, the face is actually that of Zoe Lister, an actress best known as Zoe Carpenter in the Channel 4 series Hollyoaks.

Professor Roberto Cipolla said: "This technology could be the start of a whole new generation of interfaces which make interacting with a computer much more like talking to another human being.

"It took us days to create Zoe, because we had to start from scratch and teach the system to understand language and expression. Now that it already understands those things, it shouldn't be too hard to transfer the same blueprint to a different voice and face."

The system is light enough to work in mobile phones and uses could include smartphone personal assistants or face messages to replace texts.

It works by using a set of fundamental emotions. Zoe's voice, for example, has six basic settings: happy, sad, tender, angry, afraid and neutral and the user can adjust these settings to different levels, as well as altering the pitch, speed and depth of the voice itself.

By combining these levels, it is possible to create almost infinite emotional combinations – for example, a combination of speed, anger and fear makes Zoe sound as if she is panicking.

Scientists hope the software could soon be adapted to allow people to upload their own faces and voices in a matter of seconds.

If this can be developed, a user could, for example, text the message "I'm going to be late" and ask it to set the emotion to "frustrated", so their friend would then receive a face message that looked like the sender repeating the message in a frustrated way.

The team is also working with a school for autistic and deaf children to see if Zoe could be used to help pupils read emotions or learn to lip-read.

"Present-day human-computer interaction still revolves around typing at a keyboard or moving and pointing with a mouse," Prof Cipolla said. "For a lot of people, that makes computers difficult and frustrating to use.”

"In the future, we will be able to open up computing to far more people if they can speak and gesture to machines in a more natural way. That is why we created Zoe; a more expressive, emotionally responsive face that human beings can actually have a conversation with."

Latest Issue

E&T cover image 1605

"We visit Barcelona, one of the smartest cities in the world, to find out what makes it so special. What does it look like and what is the future?"

E&T jobs

  • Senior Development Engineer, Electronics

    Premium job

    Helmet Integrated Systems / Gentex Corporation
    • Letchworth Garden City, Hertfordshire
    • Competitive

    We are an innovative, robust and fast growing business, whose main focus is to deliver continues improvement to existing products and offer new sol..

    • Recruiter: Helmet Integrated Systems / Gentex Corporation

    Apply for this job

  • Smart Grid Research Engineer

    Premium job

    University of Strathclyde
    • Cumbernauld, Glasgow
    • Grade: 6/7* £26,537 - £37,768*

    Work as part of a growing dynamic team on a wide range of technical projects with particular emphasis on experimental validation and testing

    • Recruiter: University of Strathclyde

    Apply for this job

  • Electrical Asset Specialist

    Affinity Water
    • Hatfield, Hertfordshire

    Responsible for updating and writing electrical engineering standards, approved codes of practice and safe systems of work

    • Recruiter: Affinity Water

    Apply for this job

  • Senior Electronics Engineer

    York Instruments
    • York, North Yorkshire

    Senior electronics engineer to work as part of a team developing an MEG imaging system; working with the engineering team and external contractors.

    • Recruiter: York Instruments

    Apply for this job

  • Manufacturing Engineer - Circuit Card Assembly

    MBDA
    • Lostock Junction
    • Competitive Salary & Benefits

    What’s the opportunity?   Manufacturing UK is an integral part of the Operations Directorate whose principal mission is to ensure that MBDA’s deliverable commitments are met...

    • Recruiter: MBDA

    Apply for this job

  • High Voltage Engineer

    Premium job

    Essex X-Ray & Medical Equipment
    • Great Dunmow, Essex

    This High Voltage Engineer will provide design leadership for high voltage cable assemblies up to one megavolt.

    • Recruiter: Essex X-Ray & Medical Equipment

    Apply for this job

  • Team Leader - Flank Arrays

    BAE Systems
    • Barrow-In-Furness, Cumbria, England
    • Negotiable

    Team Leader - Flank Arrays Would you like to work in a unique role within the construction of the Astute Class submarines? We currently have a vacancy for a Team Leader - Flank Arrays at our site in Barrow-in-Furness. As a Team Leader - Flank Arrays, you

    • Recruiter: BAE Systems

    Apply for this job

  • Electronics and Software Engineer

    Copley Scientific Ltd
    • Nottingham
    • circa £35,000 per annum + bonus

    Develop new test equipment for the pharmaceutical industry. Good opportunities to grow and develop. Successful family-owned and managed business.

    • Recruiter: Copley Scientific Ltd

    Apply for this job

  • Bridge Test Facility Manager

    BAE Systems
    • Shropshire, Telford, England
    • Negotiable

    Bridge Test Facility ManagerWe currently have a vacancy for a Bridge Test Facility Manager at our site in Telford with our Land UK business.As the Bridge Test Facility Manager, you will be part of our Test & Trials team, working closely with the Mili

    • Recruiter: BAE Systems

    Apply for this job

  • Intelligent Transport Systems Engineer - Highways Technology

    Premium job

    Mott MacDonald
    • Birmingham, West Midlands

    Our transport technology team in Birmingham is currently growing a highly skilled and customer-focused team to...

    • Recruiter: Mott MacDonald

    Apply for this job

More jobs ▶

Subscribe

Choose the way you would like to access the latest news and developments in your field.

Subscribe to E&T