Engineers boost cloud computing efficiency

8 March 2013
By Sofia Mitra-Thakur
Mobile version
Share |
Approach can improve performance by up to 20 per cent

Approach can improve performance by up to 20 per cent

Computer scientists at the University of California, San Diego, and Google have found a approach that allows the massive infrastructure powering cloud computing up to as much as 15 to 20 per cent more efficiently. 

Computer scientists looked at a range of Google Web services, including Gmail and search, using a unique approach to develop their model.

Their first step was to gather live data from Google's warehouse-scale computers as they were running in real time.

Their second step was to conduct experiments with data in a controlled environment on an isolated server.

The two-step approach was key, said Lingjia Tang and Jason Mars, faculty members in the Department of Computer Science and Engineering at the Jacobs School of Engineering at UC San Diego.

"These problems can seem easy to solve when looking at just one server," said Mars. "But solutions do not scale up when you're looking at hundreds of thousands of servers."

The work is one example of the research Mars and Tang are pursuing at the Clarity (Cross-Layer Architecture and Runtimes) Lab at the Jacobs School, their newly formed research group.

"If we can bridge the current gap between hardware designs and the software stack and access this huge potential, it could improve the efficiency of web service companies and significantly reduce the energy footprint of these massive-scale data centres," Tang said.

Researchers sampled 65K of data every day over a three-month span on one of Google's clusters of servers, which was running Gmail.

When they analysed that data, they found that the application was running significantly better when it accessed data located nearby on the server, rather than in remote locations. 

They also knew that the data they gathered was noisy because of other processes and applications running on the servers at the same time, so used statistical tools to cut through the noise. However, more experiments were needed.

Computer scientists then went on to test their findings on one isolated server, where they could control the conditions in which the applications were running. 

During those experiments, they found that data location was important, but that competition for shared resources within a server, especially caches, also played a role.

"Where your data is versus where your apps are matters a lot," Mars said. "But it's not the only factor."

Servers are equipped with multiple processors, which in turn can have multiple cores. 

Random-access memory is assigned to each processor, allowing data to be accessed quickly regardless of where it is stored. 

However, if an application running on a certain core is trying to access data from another core, the application is going to run more slowly, and this is where the researchers' model comes in.

"It's an issue of distance between execution and data," Tang said.

Based on these results, computer scientists developed a novel metric, called the NUMA score, that can determine how well random-access memory is allocated in warehouse-scale computers.

Optimising the NUMA score can lead to 15 to 20 per cent improvements in efficiency. 

Improvements in the use of shared resources could yield even bigger gains – a line of research Mars and Tang are pursuing in other work.

Latest Issue

E&T cover image 1607

"As the dust settles after the referendum result, we consider what happens next. We also look forward to an international summer of sport."

E&T jobs

  • Design Delivery Leader, Palace of Westminster Restoration & Renewal (R&R) - Engineering Lead

    House of Commons
    • City of Westminster, London (Greater)
    • Circa £65,000 (There may be more for an exceptional candidate)

    You will lead on a number of engineering infrastructure and associated workstreams under direction from the Deputy Director

    • Recruiter: House of Commons

    Apply for this job

  • Senior Engineer, Network Equipment

    Energy Networks Association
    • Westminster
    • £49-58k per annum, dependent on experience

    Manage issues and working groups relating to all types of equipment and assets used on the UK Transmission and Distribution Networks.

    • Recruiter: Energy Networks Association

    Apply for this job

  • Programme Manager, Network Resilience

    Energy Networks Association
    • Westminster
    • Competitive salary, dependent on experience

    Co-ordinate the network resilience, emergency planning and the Single Electricity Number (SEN) work in the ENA Engineering team.

    • Recruiter: Energy Networks Association

    Apply for this job

  • Assistant Professor (Tenure Track) of Smart Building Solutions

    Premium job

    ETH Zurich
    • Zurich, Canton of Zürich (CH)

    The successful candidate is expected to develop a strong and visible research programme in the area of control and diagnostics of building systems

    • Recruiter: ETH Zurich

    Apply for this job

  • Process Controls Leader

    Premium job

    Phillips 66
    • Humber Refinery, South Killingholme, North Lincolnshire DN40 3DW
    • £60k - 75k plus extensive Compensation and benefits package, dependent upon experience

    Experienced Process Control Leader providing leadership and technical support for Oil Refinery. Extensive Compensation and benefits package.

    • Recruiter: Phillips 66

    Apply for this job

  • Regional Technical Support Manager

    Premium job

    Siemens
    • Warwick, Warwickshire

    You will be required to lead the regional Customer Services strategy and resources to maximise Customer satisfaction.

    • Recruiter: Siemens

    Apply for this job

  • Communications Engineer

    BAE Systems
    • England, Hampshire, Portsmouth
    • Negotiable

    Communications Engineer Would you like to play a key role supporting the UK's Maritime Communications Infrastructure? We currently have a vacancy for a Communications Engineer at our site in Portsmouth. As a Communications Engineer, you will be carrying o

    • Recruiter: BAE Systems

    Apply for this job

  • MetOp-SG Receiver Project Manager

    Science and Technology Facilities Council (STFC)
    • STFC Rutherford Appleton Laboratory, Harwell, Oxfordshire
    • £37,213 - £50,926 (depending on experience)

    Project Manager to oversee the development, production and test of spaceflight components and integrated receiver systems

    • Recruiter: Science and Technology Facilities Council (STFC)

    Apply for this job

  • Financial Controller

    MBDA
    • Stevenage
    • Competitive Salary & Benefits

    An opportunity has arisen to manage a diverse range of financial controlling activities within the Equipment Team (ET) and newly Centres of Excellence (CofEx) function...

    • Recruiter: MBDA

    Apply for this job

  • Weapon System Product Support Manager

    MBDA
    • Stevenage
    • Competitive Salary & Benefits

    The Opportunity An opportunity has arisen within MBDA?s Customer Support & Services organisation for a strong competent leader to deliver a key Weapon capability primarily...

    • Recruiter: MBDA

    Apply for this job

More jobs ▶

Subscribe

Choose the way you would like to access the latest news and developments in your field.

Subscribe to E&T