Programming through biology
Can bacteria be put to work as microscopic computers in the fight against disease?
Brain work: IBM Synapse researchers Paul Merolla and John Arthur
IBM’s Synapse (Systems of Neuromorphic Adaptive Plastic Scalable Electronics)
ETH Zurich’s Yaakov Benenson:using RNA interference to make one of the most complex cell-based computers ever built
The University of Reading’s Dr Steve Temple and Professor Steve Furber
Researchers are taking inspiration from the workings of human organism when it comes to developing next-generation switches, sensors and chipsets.
The invention of the silicon transistor brought us the computer-centric world we live in, and now scientists are applying the principles of computing to biology in ways that could be equally revolutionary over the next 50 years. Whole new ways are being discovered, for example, of creating computing building blocks from prokaryotic microorganisms and DNA. Elsewhere, cognitive computing chips are being designed to create working models of human brain-functions.Researchers have the idea to create tiny computers from networks of nucleic acid molecules such as DNA and RNA, using high and low concentrations of molecules as signals, rather than the high and low voltages in electronics.
Successful proofs of principle of nucleic acid computers have already been built, and researchers are working on more complex systems. Scientists at the California Institute of Technology (Caltech) have, for instance, built a DNA-based neural network that operates like a tiny brain.
Milan Stojanovic of the Medical Centre at Columbia University in New York has developed a kind of DNA FPGA. A group at the Swiss Federal Institute of Technology in Zurich led by Yaakov Benenson has created a circuit to detect cervical cancer markers in cells and destroy the cancerous cells.
At the heart of these systems is Watson-Crick base pairing, the chemical ‘Velcro’ that binds the two strands of the DNA double helix together. Methods to exploit this phenomenon vary but the common factor is that input molecules enter a computational network and output molecules emerge that are a mathematical function of the input.
Soup-er computers
Over the years, Erik Winfree’s Caltech group has built combinations of structures such as AND, OR and NOT gates from scratch using nucleic acid strands that interact by strand-displacement in a kind of computational soup.
The project to build a ‘brain in a test tube’, led by postdoctoral scholar Lulu Qian, involved developing a soup of 112 different types of DNA structures called ‘seesaw gates’, ‘threshold gates’ and ‘fuel molecules’ that could sum input signals, apply positive or negative weights to different inputs, and set thresholds using strand-displacement. The researchers made four fully-connected artificial neurons from these elements, based on a simple model of a neuron, called a linear threshold function, in which a neuron fires and communicates with its neighbours when the sum of signals it receives is above a certain threshold.
To show that this ‘brain’ could recognise things based on incomplete patterns, the group concocted a question-game to identify one of four scientists, each represented by a set of answers to four yes-or-no questions. A human player would add to the test tube some of the DNA strands corresponding to one set of answers. Fluorescent signals triggered by the presence of particular output strands indicated which scientist the circuit had guessed. It answered correctly every time, according to Qian. This circuit could, in theory, work in a volume of one cubic micron, which is smaller than a single transistor.
Dr Milan Stojanovic at Columbia University is making strand-displacement computing circuits in a slightly different way using catalytic DNA enzymes, known as deoxyribozymes, that act on other DNA strands. Most recently his group built a multi-purpose molecular circuit that works like an electronic field programmable gate array (FPGA). The design is such that a series of DNA soup circuits all containing identical DNA logic structures can be made to operate in many ways by activating them with differently sequenced ‘training’ strands.
Computer-in-a-cell
Yaakov Benenson and his team in Zurich, working with MIT professor Ron Weiss, are creating circuits inside cells using the ready-made machinery of cellular enzymes, which nature uses to switch genes on and off and make Boolean logic-like systems that compute molecular answers in response to environmental stimuli. Benenson’s group has developed a technique using RNA interference to make one of the most complex cell-based computers ever built, although it is still much simpler than Caltech’s ‘soup’ circuits.
RNA interference is a process by which short pieces of RNA, called microRNAs, inhibit the activity of certain messenger RNA within cells. Cells have many regulation mechanisms but RNA interference is the most amenable to synthetic engineering. It can be combined in parallel, in cascade and in various other ways that enable it to perform complex computations.
Benenson and his team identified five microRNAs characteristic of cervical cancer and designed a ‘classifier’ circuit able to detect the markers and produce a protein output to destroy the cells.
“We build the template in the form of synthetic genes and the cell turns them into components,” says Benenson, “So we are hijacking the pathway that already exists, but we design new regulation mechanisms that utilise microRNA.”
EDA for DNA
As research has progressed, it has become clear that software tools are needed to help design and debug such circuits. Lulu Qian, for instance, has written a compiler, which takes a specification of a logic circuit, converts it to DNA network representations, simulates it, and provides sequences for DNA molecules.
Microsoft Research in Cambridge UK is also active in this field with Luca Cardelli, head of the programming languages group, and Andrew Phillips, head of the biological computation group, working closely with experimentalists at Caltech, Washington, and Oxford Universities to develop a programming language and software tool called DNA Strand Displacement (DSD) model to simulate and analyse strand-displacement circuits.
“With DSD, the user can write down a description of DNA complexes, including how individual DNA strands are joined together and which regions are exposed,” says Phillips, “and the tool generates the behaviour of the complexes over time.”
Phillips’ group, which is part of the computational science lab run by Stephen Emmott, also develops software for modelling systems in cells, including the Genetic Engineering of Cells (GEC) language. Work is underway to hook up different biological modelling languages in collaboration with local Cambridge researchers in synthetic biology.
“You could have a model of a DNA circuit written in DSD, which interfaces with a model of the cell machinery written in GEC, so that the DNA gets read by the cell and produces proteins, which could then act like smart drugs,” says Phillips, “So the proteins would only be produced if the right conditions are detected by the DNA circuit.”
Phillips and Cardelli predict that software tools for nucleic acid computing will rival the complexity and sophistication of those used by the computer industry, forming the foundation of a new wave of innovation.
Getting it together Strand displacement computing
Inputs in strand-displacement computing are free-floating single nucleic acid strands. Logic gates are complexes of two or more strands, one of which is the potential output signal. Sticky overhanging tabs (or ‘toeholds’) on the gates allow passing input signals to latch-on (see upper diagram below). If an input signal has a base-pair sequence complementary to a gate, it binds to it, displacing the output strand.. The free- floating output can then trigger a downstream gate so the circuit operates like a cascade (lower diagram below). Programming involves choosing the specific base sequences that make-up the different gates, and the number of types of gate and input strands.
Synthetic Biology makes the switch Building organismic electronics
One aspect of biological computing has recently shown that intestinal bacteria and even DNA can form the basis of ‘logic gates’ - devices that can be switched between two opposing states - using chemical triggers.
Biological logic gates could, think researchers at the Department of Bioengineering and the Faculty of Natural Sciences at Imperial College London, be used as ‘processors’ in microscopic ‘biological computers’. They would take form of sensors designed to detect and address pollutants and toxic substances in at-risk environmental situations, such as places with a risk of toxin leakage.
The four-year-long project - ‘Engineering modular and orthogonal genetic logic gates for robust digital-like synthetic biology’ - built a type of biological logic gate called an AND gate from an E Coli sample with modified DNA, which reprogrammed it to perform a ‘near-digital’ on-and-off switching process when stimulated by chemicals.
“In the test system we used small, simple, naturally occurring sugars as primary signals to turn on the genes,” says Professor Martin Buck of Imperial College. “These sugars can be used by bacteria for growth, and we employed the regulatory systems that control the sugar utilisation genes as primary building blocks.”
Next, a NOT gate was created, which was then combined with the AND gate to produce the more complex NAND gate. The research will attempt to develop more complex circuitry that comprises multiple logic gates. One challenge here is linking multiple logic gates together in a way similar to how electronic logic gates connect together to enable complex processing.
“Biological computing devices may include sensors that swim inside arteries to detect the build-up of plaque, and even to deliver medications to affected zones,” says Professor Buck. Other applications posited include sensors capable of detecting and destroying cancer cells.
The interdisciplinary team - which also included Professor Richard Kitney of Imperial’s Centre for Synthetic Biology and Innovation and Department of Bioengineering, Dr Nicholas Joly of the Faculty of Natural Sciences, and Baojun Wang of the Faculty of Natural Science - say that its demonstrations show that biological logic gates can be linked: this suggests the possibility of modular biological processors.
“The difference with the Imperial project is that our devices are predictable and robust, and have been shown to work in differing environments,” says Professor Kitney. “Discovering that we were able to control a naturally-occurring biological mechanism in the way we wanted to was something of a surprise. Establishing a biologically-based control system means that you can override cellular functions and start to look at ways to constraining a cell so that it operates in a desired way.”
“The next research stage could lead to a type of circuitry for processing information,” suggests Professor Buck, “complex biological circuitry processing information using chemicals, in the same way that our body uses them to process and store information. Bacterial and biological-based computers have to be seen as fundamentally different systems to silicon-based devices, and may never match the latter’s instruction execution rate. They may match in memory, but these will much slower than electronic computers in speed of operation… [However] they may well excel in dealing with problems where it is unclear what instructions to give; complex problems could instead be evolved to an answer.”
Bio-gates have more advantages over other synthesised techniques, says Professor Kitney: “They are better suited to functioning in harsh or unpredictable environments, and are able to draw energy from their local environments.”
By James Hayes, Technology Features Editor.
Chips off of the old block packet-switched brain models, and cognitive computing
University of Manchester and IBM US have, in parallel projects, developed cognitive computing chips to create working models of human brain-functions. The idea of both projects is to imitate brain abilities, such as sensation, perception, action, interaction, and cognition using high-performance computers, then see how insights can inform the development of next-generation computer systems.
Computer scientists at the University of Manchester say they have created chips based on ARM processor technology which models the human brain. Professor Steve Furber and his team from the University’s School of Computer Science have custom built the architecture for a supercomputer platform called Spinnaker (Spiking Neural Network Architecture); its purpose is to serve as an integral tool for neuroscientists, psychologists, and doctors as they understand complex brain injuries, diseases, and other conditions. For research neuroscientists, Spinnaker could help build large-scale models to verify hypotheses of neural functions; scientists can then test theories on scales and at speeds which Furber claims to be unachievable.
“I’ve been in microelectronics computing for 30 years. I’ve seen computers get faster, but they still struggle to do simple things, but to see high-performance computers act like human brains it a big step forward,” says Furber. “We don’t know how the brain works as an information-processing system, but we need to find out. Spinnaker will help gain key insights into brain activity, and patients will benefit from this.”
University of Manchester was selected to design the system architecture and received half of the £5m Engineering and Physical Sciences Research Council (EPSRC) grant; the rest is used at the universities of Southampton, Cambridge, and Sheffield, to manage the architecture, software and application sides. The team members at Manchester range from faculty academics to electrical, computer science, and psychology PhD students.
The starting point for the Spinnaker project is the fact that the basic way high-performance computers (HPC) work already has similarities with brain functions.
Modelling the 100 billion neurons with 1,000 million connections typical to the human brain, Spinnaker allows the neurons to release spikes which are relayed as minute electrical signals. Each impulse is modelled in the system as a ‘packet’ of IP data, comparable to the way the Internet transports information using IP as the principal communications protocol that used for relaying datagrams (packets) across connected networks using the Internet Protocol Suite. The ‘packet’ is then transmitted to all connected neurons which are represented by basic equations. These equations are then processed in real-time by software on the ARM chips. Each chip contains 18 ARM processors integrated in a single 19mm square package, with a second microchip that provides substantial memory using 3D system-in-package (SiP) technology.
“One of the measures that HPC folk use is the ‘bisection bandwidth’,” explains Professor Furber. “This, simply, is a measure of the bandwidth between two logical halves on the machine - if the machine were divided into two equal halves, how well would the two halves be connected? In Spinnaker, the bisection bandwidth amounts to five billion packets per second in each direction. It isn’t a big number in bits/second (250Gbps each way) as the packets are very small, but for brain-modelling small packets are all that is needed, so this number of packets is very high.”
Spinnaker systems have four nodes with 72 ARM processors, which equals to 18 processors per node. Furber says that the next-generation boards will have 48 nodes with 864 ARM processors; these boards will then be assembled into systems with up to a million ARM processors. The aspect of Spinnaker architecture that is most fixed and determined is the way the models on various ARM processors communicate with each other, by sending small packets of information. In a neural model each packet can represent the action potential or spike from a single neuron, and we can route that packet to the many thousands of other neurons in biological real time.
The University of Manchester team claims the electronic connections in Spinnaker convey these spikes much quicker and in fewer connections (five billion packets a second) compared with the biological connections in the brain. The new circuit board with 48 Spinnaker chips will be available in 2012.
Meanwhile, IBM has announced its own take on experimental cognitive computer chips to recreate the connections between spiking neurons and synapses in the brain through advanced technologies. IBM US researchers Paul Merolla’s and John Arthur’s project has some resonance with the work underway at University of Manchester, but the applications IBM foresees for its The Synapse (Systems of Neuromorphic Adaptive Plastic Scalable Electronics) project was a result of a grand challenge initiative at IBM Research - Almaden in 2006. Every year IBM management asks for the next big idea, the winner receives resources and a two year trial period. In 2008 IBM and the universities of California, Merced, Columbia, Cornell and Wisconsin, Madison were awarded $21m from DARPA (Defence Advanced Research Projects Agency). IBM collaborated with the universities as they are well known in neuroscience, supercomputing, and nanotechnology; the team varied in expertise, ranging from psychiatrists, neurologists, chip designers, mathematicians to simulation experts.
The cognitive computers are expected to learn through experiences, find correlations, create hypotheses and remember and learn from outcomes, therefore mimicking the brain structural and synaptic plasticity. IBM has two working prototype designs; both cores were fabricated in 45nm SOI-CMOS, and contain 256 neurons. One core contains 262,144 programmable synapses, and the other contains 65,536 learning synapses. The goal of Synapse is to create a system that not only analyses complex information from multiple sensory modalities, but also rewires itself to interact with the environment.
Cognitive computing systems have the potential to apply brain-like functionality to a range of high-end applications. They can, for example, monitor the environment by keeping records of global water supply, and report metrics such as temperature, pressure, wave height, and ocean tide. Cognitive computing also extends to the healthcare sector, for spotting abnormal scenarios on roads and alerting law enforcements, and recognising opportunities, risk or anomalies in the financial sector.
“These chips are step in the evolution of computers from calculators to learning systems,” says project leader for IBM Research Dhamendra Modha.
By Aasha Bodhani, Assistant Editor.
| Topic | Replies | ||
|---|---|---|---|
![]() |
UFFC | History of The Evolution of the Quartz Crystal Clock | 0 | Reply |
News
Most viewed
From forums
- E&T magazine - Debate - Nuclear energy in the UK [02:08 pm 16/05/12]
- Three Transformers in parallel operation-By Tapcon 230 [12:48 pm 16/05/12]
- How to reclassify hot site [02:42 pm 15/05/12]
- Motor Rated Fuses [12:36 pm 15/05/12]
- Reliability Engineering [11:16 pm 14/05/12]











