Skip to main content

Week 6 [18.11 - 24.11.2019] Neuromorphic computing

Remember when cell phones looked like this?


Buch of old cell phones
You could call, text, maybe play snake on it … and it had about 6 megabytes of memory, which was a small miracle at the time. Then, phones got faster and around every two years, you probably upgraded your phone from 8 gigs to 16 to 32 and so on and so forth. This incremental technological progress we’ve all been participating in for years hinges on one key trend, called Moore’s Law.

Co-founder of Intel, Gordon Moore made a prediction in 1965 that integrated circuits, or chips, were the path to cheaper electronics. Moore’s law states that the number of transistors, the tiny switches that control the flow of an electrical current that can fit in an integrated circuit, will double every two years, while the cost will halve. Chip power goes up as cost goes down. That exponential growth has brought massive advances in computing power… hence tiny computers in our pockets! A single chip today can contain billions of transistors, and each transistor is about 14 nanometres across! That’s smaller than most human viruses! Now, Moore’s law isn’t a law of physics, it’s just a good hunch that’s driven companies to make better chips.

But experts are claiming that this trend is slowing down. Granddaddy chip maker Intel recently disclosed that it's becoming more difficult to roll out smaller transistors in a two year timeframe while also being affordable. So, to power the next wave of electronics, there are a few promising options in the works. One is quantum computing. Another currently in the lab stage is neuromorphic computing, which are computer chips that are modelled after our own brains! They’re basically capable of learning and remembering all at the same time at an incredibly fast clip.

Let’s break that down and start with the human brain. So, your brain has billions of neurons, each of which forms synapses or connections with other neurons. Synaptic activity relies on ion channels, which control the flow of charged atoms like sodium and calcium that make your brain function and process properly.

 
Neuron sketch

So, a neuromorphic chip copies that model by relying on a densely connected web of transistors that mimic the activity of ion channels. Each chip has a network of cores, with inputs and outputs that are wired to additional cores, which all operate in conjunction with each other. Because of this connectivity, neuromorphic chips are able to integrate memory, computation, and communication all together.


Simplified model of chip based neuromorphic architecture


These chips are an entirely new computational design. Standard chips today are built based on von Neumann architecture where the process and memory are separate and the data moves between them. A central processing unit runs commands that are fetched from memory to execute tasks. This is what’s made computers very good at computing, but not as efficiently as they could be.


Simplified model of chip based on von Neumann architecture

Neuromorphic chips however completely change that model by having both storage and processing connected within these “neurons” that are all communicating and learning together. The hope is that these neuromorphic chips could transform computers from general purpose calculators into machines that can learn from experience and make decisions. We'd leap to a future where computers wouldn't just be able to crunch data at break neck speeds but could do that AND process sensory data in real time. Some future applications of neuromorphic chips might include combat robots that could decide how to act in the field, drones that could detect changes in the environment, and your car taking you to a drive through for ice cream basically these chips could power our future robot overlords. We don't have machines with sophisticated, brain-like chips yet but they’re on the horizon. So get ready for a whole new meaning for the term “brain power.”

Sources:
https://www.investopedia.com/terms/m/mooreslaw.asp
https://en.wikipedia.org/wiki/Neuron
https://www.intel.pl/content/www/pl/pl/research/neuromorphic-computing.html
https://towardsdatascience.com/neuromorphic-hardware-trying-to-put-brain-into-chips-222132f7e4de
https://www.semanticscholar.org/paper/Neuromorphic-devices-and-architectures-for-Burr-Narayanan/1f170ebf03c5c269f873d2a129ba4dc4cfb08cc2

  1. Do you think that neuromorphic architecture could replace standard von Neuman architecture?
  2. What applications do you see for artificial intelligence based on this architecture.?
  3. Are you afraid of skynet scenario?

Comments

Kacper Gąsior said…
1. Right now, von Neuman architecture is a standard. Not only hardware is being developed in accordance with this standard but also software. Despite big advantages of solutions like neuromorphic architectures it will take years before such change will begin. Of course I'm aware of von Neuman architecture limitations and I'm sure that companies will have to think about changing the basics to be able to go further. I think that it just needs a lot of time and money.

2. I think that it may be able to perform better with all artificial intelligence applications that are being developed nowadays. Of course it will also accelerate development of them and maybe one day cars will be fully autonomous, software will be able to diagnose and conduct a surgery or even make strategical decisions in politics or the economy.

3. Right now - no. Artificial intelligence algorithms have their limitations. They're able to perform really good at some tasks, but it can't link these results and create something more complex. Maybe development of things like neuromorphic architecture, which seems to be ideal for e.g. neural networks, will accelerate this process and enable more complex solutions.
1.Do you think that neuromorphic architecture could replace standard von Neuman architecture?
It could in distant future. Neuman software and hardware architecture is used right now almost everywhere and replacing architecture made like this will take years to develop.

2.What applications do you see for artificial intelligence based on this architecture.?
Many applications nowdays are using AI based on architecture because it is way of the future. I see most of the applications working this way in the future.

3.Are you afraid of skynet scenario?
No, I'm not. Or at least i don't belevie I will be alive in that moment.
Olha Romaniuk said…
1. Do you think that neuromorphic architecture could replace standard von Neuman architecture?
Not completely. Different architectures are suitable for different purposes. I do not think that neuromorphic architecture will be a universal solution to all problems.

2. What applications do you see for artificial intelligence based on this architecture.?
Everywhere. Of course, not everywhere it will give exact results. But it will definitely be interesting to look at it. Sometimes AI does strange things.

3. Are you afraid of skynet scenario?
I'll program my robots so they can't hurt me under any circumstances, they just protect me.
Kyrylo said…

Do you think that neuromorphic architecture could replace standard von Neuman architecture?
It is different, indeed. Every change in something well established with consecutive improvement in characteristics is a natural development cycle.
What applications do you see for artificial intelligence based on this architecture.?
Neural networks have proven their capability near in every sphere of science and learning. Although the only thing a program can do is execute its own code -- we do not know whether the human is not as well. This might be the answer to the human source code.
Are you afraid of skynet scenario?
Not at all. In fact, it is inevitable, as a result of natural development of technology.
1. Do you think that neuromorphic architecture could replace standard von Neuman architecture?

At the moment it is only a novelty for which we can look for new applications in which it will work better than others. Replacement of the current architecture will not happen so soon but maybe it will be the future as von neuman architecture will come to its limits.

2. What applications do you see for artificial intelligence based on this architecture.?

Definitely the robotics and autonomous vehicles industry.

3. Are you afraid of skynet scenario?

Looking at the current development of AI, I am not afraid of it yet, but who knows what will happen one day ...
1. Do you think that neuromorphic architecture could replace standard von Neuman architecture?
As far as I know, Neuman software and hardware architecture is used almost everywhere today. Her successor would have to be immaculate. This can take a long time.

2. What applications do you see for artificial intelligence based on this architecture.?
The car industry, mainly passenger or public use (metro, trams, buses).

3. Are you afraid of skynet scenario?
Looking at the current development of artificial intelligence, I'm not afraid of him yet.
Adam Tokarczyk said…
1. One day, something for sure will have to replace then obsolete von Neumann architecture. It's not a time for it yet though. Von Neumann still is a standard and will reign probably for quite long. Whether it will be replaced by neuromorphic architecture or something else is hard to say as it's not fully developed yet.

2. Human will most likely find a way to put it everywhere, but what comes to mind first are probably robots. It would surely be nice to see Boston Dynamics creations running this architecture.

3. Not really. All you have to do is put if statement to restrict them from going evil or removing red lights and problem solved :). And even if it won't work they will still need us to read captcha for them. On a serious note though, I highly doubt that we will advance enough in my lifetime, for such scenario to appear.
Mateusz Szych said…
1. I don't know if neuromorphic architecture will replace von Neumann architecture, but it is certain that one day there will be a change, we will not be able to develop this architecture indefinitely.

2. All of which are now based on AI. It's hard to say what else we can use AI for.

3. Artificial intelligence is weak and I doubt that in my life it will achieve such power that it could create a global threat.

Popular posts from this blog

Week 11 [03-09.06.2019] The problem with ecological cars emission in UK

The problem with ecological cars emission in UK Since the adoption of the European Emission Allowance Directive in the European Parliament, all car makers have tried to submit. Since 1992, the Euro I standard has been in force, which limited the emission of carbon monoxide to the atmosphere. The Euro VI standard currently applies, which limits the series of exhaust gases. These include: hydrocarbons, nitrogen and carbon oxides, and dust.   The most significant change was brought by the Euro IV standard. For the first time it introduced the limitation of nitrogen oxides, which are responsible for the harmful compounds of smog.   What is smog?   Smog consists of sulfur oxides, nitrogen and carbon. In addition, solid substances such as suspended dust (PM). Dust suspend in atmospheric aerosols may be in liquid and solid form. These can be particles of sea salt, clouds from the Sahara and artificial compounds made by people. These compounds often come fr

Week 12 (12.01-18.01.15) Are you an early bird or a night owl ?

Owls are nocturnal creatures. They’re wide awake at night and they sleep during the day. If this sounds like bliss to you, then, like about 20 percent of the population who find themselves most active at around 9 pm, you may fall into the same category as our feathered friend. Night owls often have difficulty waking up in the morning, and like to be up late at night.  Studies of animal behaviour indicate that being a night owl may actually be built into some people’s genes. This would explain why those late-to-bed, late-to-rise people find it so difficult to change their behaviour. The trouble for night owls is that they just have to be at places such as work and school far too early. This is when the alarm clock becomes the night owl’s most important survival tool. Experts say that one way for a night owl to beat their dependence on their alarm clocks is to sleep with the curtains open. The Theory is that if they do so, the morning sunlight will awaken them gently and naturally.

Week 4 [06-12.11.2017] This is what happens when you reply to spam email.

James Veitch is a British comedian. In today’s Ted Talk James with characteristic for himself a sense of humor shows how he deals with spam emails and why responding to junk messages may be sometimes dangerous. Questions: What do you think about James’s  way of dealing with spam? Why are junk messages legal, even though it sometimes may be a fraud? Dou you have a problem with spam? How do you deal with with it?