Future games machines to read your emotions

14 December 2011
By Paul Dempsey
Mobile version
Share |
Sony PS Vita

Sony’s roadmap runs well beyond the soon-to-be-launched PS Vita


The senior technologist in Sony’s PlayStation division provided a tantalising view of the company’s gaming roadmap at the International Electron Devices Meeting in Washington DC this month.

Masaaki Tsuruta, EVP, Technology Platform and CTO, Sony Computer Entertainment, set out the electronics giant’s requirements for hardware innovation to realise its evolving vision of ‘Interactive Games’. These almost entirely depend on advanced research in the semiconductor community today, rather than ‘blue skies’ work.

Not all of the road map will feature in the next PlayStation – this was explicitly not a specification – but it seems certain that some of it will, and other elements could be added later via peripherals. Some, though, are more long-term.

One of Sony’s most striking goals was advanced haptics that can replicate sensations as specific as stroking a cat. “What we have today is solely based on vibration.” Tsuruta-san then envisaged the use of broader sensor technology that might read vital signs, body heat and facial expressions to gauge a player’s emotions and use them in the context of a game.

Sony also wants to drive still higher display resolutions (towards 8k x 4k) and frame rates (to above 300fps) while reducing response latency for highly immersive games to less than 50ms (we can detect latencies of 10-20ms, but this would still be a major advance).

Tsuruta-san described a number of existing technologies that could be incrementally enhanced to deliver some of his company’s plans relatively soon.

Sony’s new handheld console, the PSVita, goes on sale in Japan this month and in Europe next February. It features a nine-axis accelerometer (3 accelerometers, 3 gyroscopes and 3 magnetometers), but we could soon see a tenth added to sense pressure and increase environmental feedback still further.

In terms of semiconductors, Tsuruta-san picked out emerging ‘through silicon via’ designs. These stack chips with interconnects running vertically through them to reduce length, raise performance and reduce power consumption.

Early use of TSVs has been confined to memories – it is inherently easiest to stack like-on-like – but they represent a potential near-term solution to the challenge of shortening links between gaming’s cutting-edge requirements to combine raw processing muscle with heavy-duty graphics processing and huge amounts of memory. They would also help Sony work towards its latency target.

All these technologies could help Sony further develop the concept of ‘Augmented Reality’, which will be launched in small screen on the Vita. This allows gamers to insert 3D computer-generated figures into their actual environment as viewed though the console display.

Looking further out, Tsuruta-san imagined a version of AR ultimately delivered via see-through 3D glasses, essentially a lightweight stereoscopic head-up display. This, however, will have to wait on the capability to deliver a massive amount of real-time graphics processing locally on a headset and to accurately position virtual truly-3D figures in a dynamically changing environment.

Latest Issue

E&T cover image 1607

"As the dust settles after the referendum result, we consider what happens next. We also look forward to an international summer of sport."

E&T jobs

  • Spectrum Technology Analyst

    • Baldock, Hertfordshire
    • £Competitive Plus Comprehensive Benefits Package

    Ofcom is the independent regulator and competition authority for the UK communications sectors and we are globally respected for the work we do.

    • Recruiter: Ofcom

    Apply for this job

  • Test Engineering Opportunities

    • Hanslope Park, Milton Keynes
    • Salary offered will depend on skills and experience

    Push incredible innovations beyond their limits. Opportunities for Software, Hardware, EMC, Test and Inspection Engineers!

    • Recruiter: HMGCC

    Apply for this job

  • Development Engineer Opportunities

    • Hanslope Park, Milton Keynes
    • Salary offered will depend on skills and experience

    At HMGCC, we’re the place where exceptional creativity, ground-breaking ideas and cutting-edge technologies unite.

    • Recruiter: HMGCC

    Apply for this job

  • Head of School of Engineering and Advanced Technology

    Massey University
    • Albany or Palmerston North

    This role offers an outstanding opportunity to lead and further develop a well-established and internationally recognized School.

    • Recruiter: Massey University

    Apply for this job

  • Engineering Support Opportunities

    • Hanslope Park, Milton Keynes
    • Salary offered will depend on skills and experience

    Working in one of our support roles, you’ll be integral to the creation of some of the most advanced bit of kit in the world.

    • Recruiter: HMGCC

    Apply for this job

  • Programme Manager, Network Resilience

    Energy Networks Association
    • Westminster
    • Competitive salary, dependent on experience

    Co-ordinate the network resilience, emergency planning and the Single Electricity Number (SEN) work in the ENA Engineering team.

    • Recruiter: Energy Networks Association

    Apply for this job

  • Senior Engineer - Configuration

    BAE Systems
    • Surrey, Frimley, England / England, Weymouth, Dorset
    • Negotiable

    Senior Engineer - Configuration Would you like to assist the Combat System Configuration Manager in ensuring that changes to the Common Combat System design are sufficiently assessed, approved, implemented, managed and controlled in accordance with BAE Sy

    • Recruiter: BAE Systems

    Apply for this job

  • System Planning and Investment Engineer

    • Reading
    • 37,000 - £55,000 Plus excellent benefits package - salary depending on experience

    System Planning and Investment team act as custodian of the 132kV and EHV distribution network, provide business with technical expertise.

    • Recruiter: SSE

    Apply for this job

  • Chair in Integrated Sensor Technology

    The University of Edinburgh
    • Edinburgh, City of Edinburgh

    The University of Edinburgh is one of the world’s top 20 institutions of higher education.....

    • Recruiter: The University of Edinburgh

    Apply for this job

  • Metering Engineer

    Department for Business, Innovation and Skills
    • Teddington, United Kingdom
    • £24,109 - £27,961 plus EO Electronics PE of £8,090.00

    We are now looking for a Metering Engineer to deliver RD’s In-Service Testing (IST) scheme for gas and electricity meters.

    • Recruiter: Department for Business, Innovation and Skills

    Apply for this job

More jobs ▶


Choose the way you would like to access the latest news and developments in your field.

Subscribe to E&T