Smart robots detect boredom and steer clear of humans

23 October 2015
By Jack Loughran
Mobile version
Share |
SINTEF researcher Marianne Bakken attempts to collide with the robot arm but it manages to avoid her every time

SINTEF researcher Marianne Bakken attempts to collide with the robot arm but it manages to avoid her every time

A user is shown interacting with the Talking-Ally robot

A user is shown interacting with the Talking-Ally robot

Human-robot interactions are set to become more complex as the result of research from two separate teams that gives robots more naturalistic movement and conversational abilities.

One team of researchers at Toyohashi University of Technology in Japan has devised artificial intelligence that can take into account the listener's attention and alter its behaviour accordingly.

Another team at Scandinavian research organisation SINTEF has developed a robot that is able to adjust its movements in order to avoid colliding with people and objects around it.

The machine, dubbed Talking-Ally, developed by the Japanese team, follows a person's gaze to determine if they are distracted by another event occurring in the background or something in their surroundings.

The robot bends forward and nods if the person is watching television or it turns its head and looks around if the person is looking elsewhere. These behaviours are accompanied by appropriate speech that is intended to regain the person's attention.

Most existing robots use monologue mechanisms and will continue speaking in the same way even if the person is not paying attention to them.

Experiments have confirmed that the adaptive interaction from the new model considerably increases the other party's attention toward the robot compared with gestures and speech generated without considering the person's gaze.

"We have set up an environment to manipulate the person's attention with an engaging sports program broadcast simultaneously with the human-robot interaction. This allowed us to validate a suite of conversation situations and utterance-generation patterns," said Hitomi Matsushita, first author of a paper on the robot.

"Talking-Ally dynamically determines and synchronizes its body language, turn initials, and entrust behaviours within the speech, according to the person's attention coordinates," researcher Michio Okada explained. "Our analysis shows that this is significantly more persuasive than generating these behaviours randomly."

The Scandinavian team at SINTEF has developed a robot that adjusts its movements in order to avoid colliding with the people and objects around it.

Currently, industrial robots weigh several tonnes and are placed inside netting enclosures to prevent them from colliding with, and causing damage to, people and objects around them. This forces them to remain static and perform repetitive tasks entirely separated from their fellow human operators on the same production line.

The new machines are equipped with light-duty arms that can be easily integrated into existing production systems and are safer to work with. The researchers installed a 3D sensor on the robot which can detect objects in the space around it, and senses where any given object is located in relation to the robot arm.

With this information it is able to avoid contact with humans and objects while operating alongside them.

"We've managed to obtain updates of the robot's movements at a rate of ten times a second", said SINTEF researcher Marianne Bakken. "By combining fast sensor technology with smart algorithms, we can achieve a uniform and seamless manoeuvre."

"In the future we can envisage robots that move around the workplace carrying out tasks without colliding with people or the objects around them."

Bakken has demonstrated the technology (see picture above) by attempting to get close and personal with an orange robot arm, moving in all directions to try to get the robot to collide with her, but it manages to avoid her every time.

Latest Issue

E&T cover image 1607

"As the dust settles after the referendum result, we consider what happens next. We also look forward to an international summer of sport."

E&T jobs

  • Control System Engineer

    United Utilities
    • Lancaster, Lancashire
    • Up to £33415 + Comprehensive Benefits

    Provide ICA maintenance and engineering support to the Water & Wastewater Production

    • Recruiter: United Utilities

    Apply for this job

  • Signal Processing Engineer

    B&W Group
    • Steyning, West Sussex
    • Competitive Salary

    We are looking for a Signal Processing Engineer to support the R&D process on active loudspeaker products.

    • Recruiter: B&W Group

    Apply for this job

  • Principal Mechanical & Electrical Engineer

    De Montfort University
    • Leicestershire
    • Grade G: £36,672 - £46,414 per annum

    Join the Projects Team to develop and manage medium to large projects on the university estate.

    • Recruiter: De Montfort University

    Apply for this job

  • Advanced Commissioning Engineer

    National Grid
    • Nottinghamshire, Nottingham, England
    • £46000 - £57000 per year

    National Grid is at the heart of energy in the UK. The electricity we provide gets the nation to work, powers schools and lights everyone's way home. Our energy network connects the nation, so it's essential that it's continually evolving, advancing and i

    • Recruiter: National Grid

    Apply for this job

  • Electrical Design Engineer

    Oxford Instruments
    • Yatton, Bristol
    • Competitive salary plus excellent benefits

    We are looking for an electrical designer to join our engineering design team.

    • Recruiter: Oxford Instruments

    Apply for this job

  • Skilled Electrical Fitter

    • Bolton
    • Competitive Salary & Benefits

    What?s the opportunity?   The Electrical Fitter will carry out manufacturing and test tasks within the electrical department in accordance with product certification procedures, defined workmanship  ...

    • Recruiter: MBDA

    Apply for this job

  • Electrical Manufacturing Technician

    • Stevenage
    • Competitive Salary & Benefits

    What?s the opportunity?   As a qualified craftsman with experience in electrical manufacturing, the Manufacturing Technician will report to a Team Leader, receiving day to day ...

    • Recruiter: MBDA

    Apply for this job

  • Consultant Engineer (Electrical Power)

    BAE Systems
    • Cumbria, Barrow-In-Furness, England
    • Negotiable

    Consultant Engineer (Electrical Power) Would you like to play a key role in providing technical direction to the design of power systems on the Successor class submarines, which will replace the current Trident-equipped Vanguard class, currently in servic

    • Recruiter: BAE Systems

    Apply for this job

  • Electrician

    The Bristol Port Company
    • City of Bristol
    • C. £31,729 per annum plus supplements, benefits and overtime

    You’re a good team worker with a strong technical capacity – so bring your talents to a new role with one of the area’s leading employers.

    • Recruiter: The Bristol Port Company

    Apply for this job

  • Supply Restoration Team Manager (HV/SAP)

    • Oxford, Oxfordshire
    • Salary: £37,588 to £49,645 + Car (SSE8) Depending on skills and experience

    SSE is looking to recruit a Supply Restoration Team Manager to join our existing team in Oxford.

    • Recruiter: SSE

    Apply for this job

More jobs ▶


Choose the way you would like to access the latest news and developments in your field.

Subscribe to E&T