---
title: Convolutional neural networks in action - Imagination
description: In recent years, deep learning, and specifically the use of convolutional neural networks, are beginning to give computers the ability to 'see'.
image: https://blog.imaginationtech.com/hubfs/Imported_Blog_Media/artificial-intelligence-155161__340-1.png
---
[ ](https://blog.imaginationtech.com/)
- [Products & Solutions](https://www.imaginationtech.com/products/)
- [GPU](https://www.imaginationtech.com/products/gpu/)
- [CPU](https://www.imaginationtech.com/products/cpu/)
- [AI](https://www.imaginationtech.com/products/ai/)
- [Ethernet](https://www.imaginationtech.com/products/ethernet/)
- [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/)
- [Automotive](https://www.imaginationtech.com/products/automotive/)
- [Consumer](https://www.imaginationtech.com/products/consumer/)
- [Desktop](https://www.imaginationtech.com/products/desktop/)
- [Mobile](https://www.imaginationtech.com/products/mobile/)
- [Product Finder](https://www.imaginationtech.com/products/catalog/)
- [Developers](https://developer.imaginationtech.com/)
- [News & Insights](https://www.imaginationtech.com/news/)
- [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=)
- [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=)
- [Blog](https://blog.imaginationtech.com/)
- [Events](https://www.imaginationtech.com/events/)
- [Webinars](https://www.imaginationtech.com/webinars/)
- [University Programme](https://university.imgtec.com/)
- [中文社区](http://imgtec.eetrend.com/)
- [Company](https://www.imaginationtech.com/about/)
- [About Us](https://www.imaginationtech.com/about/)
- [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/)
- [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/)
- [Corporate Social Responsibility](https://www.imaginationtech.com/csr/)
- [Leadership Team](https://www.imaginationtech.com/leadership/)
- [Contact Us](https://www.imaginationtech.com/contact-us/)
- [Careers](https://www.imaginationtech.com/careers/)
- [Work at Imagination](https://www.imaginationtech.com/careers/)
- [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/)
- [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/)
- [Early Careers](https://www.imaginationtech.com/careers/early-careers/)
- [Search Jobs](https://www.imaginationtech.com/careers/vacancies/)
- [Products & Solutions](https://www.imaginationtech.com/products/)
- [GPU](https://www.imaginationtech.com/products/gpu/)
- [CPU](https://www.imaginationtech.com/products/cpu/)
- [AI](https://www.imaginationtech.com/products/ai/)
- [Ethernet](https://www.imaginationtech.com/products/ethernet/)
- [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/)
- [Automotive](https://www.imaginationtech.com/products/automotive/)
- [Consumer](https://www.imaginationtech.com/products/consumer/)
- [Desktop](https://www.imaginationtech.com/products/desktop/)
- [Mobile](https://www.imaginationtech.com/products/mobile/)
- [Product Finder](https://www.imaginationtech.com/products/catalog/)
- [Developers](https://developer.imaginationtech.com/)
- [News & Insights](https://www.imaginationtech.com/news/)
- [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=)
- [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=)
- [Blog](https://blog.imaginationtech.com/)
- [Events](https://www.imaginationtech.com/events/)
- [Webinars](https://www.imaginationtech.com/webinars/)
- [University Programme](https://university.imgtec.com/)
- [中文社区](http://imgtec.eetrend.com/)
- [Company](https://www.imaginationtech.com/about/)
- [About Us](https://www.imaginationtech.com/about/)
- [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/)
- [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/)
- [Corporate Social Responsibility](https://www.imaginationtech.com/csr/)
- [Leadership Team](https://www.imaginationtech.com/leadership/)
- [Contact Us](https://www.imaginationtech.com/contact-us/)
- [Careers](https://www.imaginationtech.com/careers/)
- [Work at Imagination](https://www.imaginationtech.com/careers/)
- [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/)
- [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/)
- [Early Careers](https://www.imaginationtech.com/careers/early-careers/)
- [Search Jobs](https://www.imaginationtech.com/careers/vacancies/)
×
[Automotive](https://blog.imaginationtech.com/tag/automotive)
## Convolutional neural networks in action
By [Benny Har-Even](https://blog.imaginationtech.com/author/benny-har-even)
May 4, 2017 | 5 min read
- 04 May 2017
- [Benny Har-Even](https://blog.imaginationtech.com/author/benny-har-even)
These days we seem to take it for granted how powerful and sophisticated computers have become. We can talk to our phones and our Bluetooth speakers and they will respond with context-aware information; in certain cars you can take your hands off the wheel and let yourself be carried down the road by electronics, and we can share messages and pictures with anyone anywhere in the world at the touch of a button.
But one area where our devices are still very much in their infancy is that of computer ‘vision’. While we have ever-better cameras in our pockets, in terms of understanding the world these devices are relatively dumb. While they can see with ever greater clarity, they can’t yet understand what they are seeing.
For example, if you show a three-year-old child an image of a person standing next to an elephant, they would have no issues telling you what they are seeing but for a computer to do the same would be extremely challenging.
Computers can only recognise objects once they’ve been trained using large image datasets
However, things are changing. In recent years a field of computing called ‘deep learning’ has greatly enhanced the ability of computers to understand as well as they can see. Rather than relying on traditional image processing techniques, deep learning, and specifically the use of convolutional neural networks, are beginning to make significant inroads into giving computers the ability to make sense of the world.
Convolutional neural networks were first pioneered back in the late 1980s based on based on a series of earlier work in the 1960s on Artificial Neural Networks (ANNs) and Multilayer Perceptrons (MLPs). They were originally designed to work in a similar way to the human brain. Of course much like a human brain, in order to do their job well, they need lots of data on which to be trained.
CNNs became more widely known and used around 2005 with the rise of modern GPUs, as their ability to process repetitive tasks at speed make it practical to use CNNs.
Work in the field on giving computers visual intelligence made a significant leap in 2012 when Alex Krizhevsky used a neural network to win the ImageNet challenge. This is a huge image database of millions of images that was created in 2007 by Professor Kai Li at Princeton University to provide computers with enough training data to help them learn in the same way a child would. The ImageNet challenge is commonly described as the annual Olympics of computer vision and tests how fast a computer can learn to understand what it’s seeing based on a large selection of images; the fewer errors, the greater the score.
[](https://blog.imaginationtech.com/hubfs/Imported_Blog_Media/Figure-4-AlexNet-CNN-architecture-Extracted-from-26.png)
The AlexNet CNN made a large impact in 2012 by rapidly increasing image recognition performance
At the time, Krizhevsky was able to reduce the error rate down from 26% to 15% – a major improvement and it was all made possible by the use of a convolution neural network. Each year this process is improved further as teams create ever better systems to speed up and improve the ability of devices to understand images.
The performance of CNNs on ImageNet has developed rapidly in recent years.
But how are CNNs being used in the real world today and what impact are they having?
**Assistive technology**
In a famous scene from 2001: A Space Odyssey, astronauts David Bowman and Frank Poole hide in a pod where HAL, the ship’s computer, cannot hear them discussing his odd behaviour. However, HAL is able to read their lips and works out that are going to deactivate him – with infamous results. Well, we now know that he would have used a CNN to decipher what they were saying. There are more down to earth uses for a lip reading computer, such as getting transcriptions from video content where the audio is not available, such as for journalists to obtain off-mic comments from politicians or celebrities.
HAL 9000 from the 1968 movie 2001: A Space Odyssey showed a computer lipreading.
A group from the University of Oxford has [proposed using a CNN exactly for this](https://www.robots.ox.ac.uk/~vgg/publications/2016/Chung16/chung16.pdf), while another paper submitted to the IEEE proposes how a CNN could be used to “reduce the negative influence caused by shaking of the subject and face alignment blurring at the feature-extraction level.” It produced a word recognition rate of up to 71.76%, far superior to conventional methods.
However, you can also see the power of CNNs actually running in your hand today. An app called AIPoly, designed to assist blind and partially sighted people leverages an Imagination PowerVR GPU in identifying objects using the smartphone camera and says out loud what they are.
**Automotive**
CNN are closely associated with automotive but actively using them to power self-driving cars is still a work in progress. [This paper from Cornell University](https://arxiv.org/abs/1601.05610) discusses how they can be effectively used to recognise car license plates with CNNs to deliver better results than conventional approaches. Of course, license plate aren’t as unpredictable as moving objects such as pedestrians, but a paper discusses using CNNs to achieve this with improved efficiency over previous methods.
When it comes to those pesky moving objects known as people CNNs are also expected to play a key role as the foremost algorithm type used in ADAS and autonomous vision systems in cars. CNNs are extremely efficient at analysing a scene and breaking it up into its recognisable components until objects, people, cars, trucks, road kerbs and road signs are recognised through a camera-based system. By using vast amounts of training data, the Convolutional Network can ‘learn’ what to look for and extract this from a scene while driving in real time. As an example, through the various layers of the CNN one can detect corners/curves, followed by circles, then road signs and finally, what the road sign means. This is then passed onto a sensor fusion element to take inputs from other sensors i.e. LiDAR or radar to make sense of the bigger picture, and then act upon them either by flashing a warning via the Multi Media Interface or by taking control of braking and or steering.
CNNs can be implemented on the CPU or using GPU compute, which is much more efficient – often by at least a factor of ten – or by hardware acceleration, which will ultimately yield the highest performance at the lowest power and silicon footprint.
**Medical**
By their very nature, CNNs are very good at detecting patterns, making them well suited to assisting in medical situations. As [this article in Nature.com discusses](https://www.nature.com/articles/srep26286) they can be very effective in increasing the accuracy of recognising cancers and have been used to pick up “primary breast cancer detection12, glioma grading13 and epithelium and stroma segmentation”. Their efficiency means they can reduce the workload for pathologists and the paper concludes that “’deep learning’ holds great promise to improve the efficacy of prostate cancer diagnosis and breast cancer staging.”
[](https://blog.imaginationtech.com/hubfs/Imported_Blog_Media/cancer_detection_CNN.jpg)
Equally, a paper from Cornell University on [using CNNs to aid in breast cancer screening](https://arxiv.org/abs/1703.07047) considers the issues that arise when down-sampling the image fidelity of training data and suggests that image resolution must be maintained to ensure the best performance.
**Industrial**
If you’re afraid of the thought of computers building themselves, then you might have cause to worry. The semiconductor industry is one that is looking at using deep learning to [aid in the design and manufacturing of advanced integrated circuits](https://semimd.com/blog/2017/03/23/deep-learning-could-boost-yields-increase-revenues/). CNNs are seen as being very well suited to solving certain manufacturing problems. In a similar vein to identifying cancers, the ability of CNNs to spot patterns will be put to good use in the lithography process, greatly reducing manufacturing defects and helping to increase yields.
CNNs are also being widely used to recognise foods. [This paper discusses using a CNN for automatic diet recognition](https://arxiv.org/abs/1607.08811v1) to enable specialists to discover unhealthy food patterns. There are several papers that describe using CNNs in this way; this one refers to it as ‘DeepFood’ for computer aided dietary assessment, improving health and longevity.
**Social Media**
Making digital images look great is a skill that many people spend a lot of time perfecting, through careful use of image retouching tools. An experimental process from Adobe and Cornell University called “[Deep Photo Style Transfer](https://www.theverge.com/2017/3/30/15124466/ai-photo-style-transfer-deep-neural-nets-adobe)” is looking to make those people redundant, by applying artificial intelligence. This app can take the style of one photo and automatically apply it to another, with dramatic results.
CNNs are also widely used by sites such as Facebook. Here the company describes how they use one in [DeepText](https://code.facebook.com/posts/181565595577955/introducing-deeptext-facebook-s-text-understanding-engine/), which they describe as “a deep-learning-based text understanding engine that can understand with near-human accuracy the textual content of several thousand posts per second, spanning more than 20 languages.”
**Conclusion**
Imagination is naturally looking closely at ways of accelerating the use of inference engines; that is the running of CNNs on devices once they have been fully trained on datasets. As we [demonstrated last year](https://blog.imaginationtech.com/deep-learning-mobile-embedded-vision-summit/) our PowerVR Rogue GPUs already offer 3x greater efficiency and up to 12x faster performance than running on a CPU, and our new PowerVR Furian architecture will offer even greater performance and power efficiency.
One of our recent blog posts highlights our work in this area and how we are the first to make use of the CNN extension in OpenVX, the open source standard API for computer vision.
We are continuing to work in this sphere and Imagination’s Paul Brasnett recently spoke at the Embedded Vision Summit on the subject of ‘[**Training CNNs for Efficient Inference**](https://www.edge-ai-vision.com/)‘. In his presentation, he explained Imagination’s approach to improving the efficiency of running CNNs on hardware where power and area constraints are of primary concern, such as on mobile devices and in automotive.
It’s an exciting time for computer vision, and Imagination will be at the heart of it. We look forward to bringing you news regarding upcoming products that will make even greater strides in this area in the coming months.
[Automotive](https://blog.imaginationtech.com/tag/automotive)
#### Share this post
-
- [mailto:?subject=https://blog.imaginationtech.com/convolutional-neural-networks-in-action/](mailto:?subject=https://blog.imaginationtech.com/convolutional-neural-networks-in-action/)
##### About the Author
[Benny Har-Even](https://blog.imaginationtech.com/author/benny-har-even)
Benny Har-Even was the content manager at Imagination, where he casted an editorial eye over the company’s output—from blog posts to white papers, to web pages and video material. He has a background in technology journalism that goes back to the late 1990s and has written for many leading publications from the Sunday Times and TrustedReviews.com to Wired magazine. In his spare time, he is a contributor to Forbes online. Benny left Imagination in 2023.
[More from Benny Har-Even](https://blog.imaginationtech.com/author/benny-har-even)
### Subscribe to our blog
### Introducing E-Series GPU
Imagination E-Series GPU IP breaks through the barriers of throughput, memory, and power at the edge.Built for next-gen AI, E-Series delivers high performance and adaptability across mobile, automotive, desktop, and consumer markets, avoiding the rigidity of fixed-function accelerators while retaining the flexibility of GPU programmability.
[Learn more](https://www.imaginationtech.com/products/e-series/)
### Read Next
[](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc)
## [Imagination & Chiplets: Scaling System Design Beyond the Monolithic SoC](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc)
[Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu)
4 min read
For many years, improvements in SoC performance came from process scaling and integrating more...
[Read more](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc)
[](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu)
## [Ambarella's CV3-AD655 Surround View with IMG BXM GPU: A Case Study](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu)
[Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu)
2 min read
Ambarella’s CV3-AD655 autonomous driving AI domain controller pairs energy-efficient compute with...
[Read more](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu)
[](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface)
## [How fast a GPU do you need for your user interface?](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface)
[Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu) [Consumer](https://blog.imaginationtech.com/tag/consumer)
4 min read
Graphical user interfaces (GUIs) are common across all walks of life, from your smartphones to your...
[Read more](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface)
- Products
- [GPU](https://www.imaginationtech.com/products/gpu/)
- [CPU](https://www.imaginationtech.com/products/cpu/)
- [AI](https://www.imaginationtech.com/products/ai/)
- [Ethernet](https://www.imaginationtech.com/products/ethernet/)
- [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/)
- [Open Access](https://www.imaginationtech.com/products/open-access/)
- [Design Optimization Kit](https://www.imaginationtech.com/products/design-optimisation-kit/)
- [Product Finder](https://www.imaginationtech.com/products/catalog/)
- Developers
- [Developers](https://developer.imaginationtech.com/)
- [PowerVR SDK and Tools](https://developer.imaginationtech.com/powervr-sdk/)
- [Developer Downloads](https://developer.imaginationtech.com/downloads/)
- [Developer Documentation](https://docs.imgtec.com/)
- [Developer Forums](https://forums.imgtec.com)
- About Imagination
- [About Us](https://www.imaginationtech.com/about/)
- [Career Opportunities](https://www.imaginationtech.com/careers/)
- [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/)
- [Corporate Social Responsibility](https://www.imaginationtech.com/csr/)
- [Imagination Leadership](https://www.imaginationtech.com/leadership/)
- [Contact Imagination](https://www.imaginationtech.com/contact-us/)
- Applications
- [Automotive](https://www.imaginationtech.com/products/automotive/)
- [Consumer](https://www.imaginationtech.com/products/consumer/)
- [Desktop](https://www.imaginationtech.com/products/desktop/)
- [Mobile](https://www.imaginationtech.com/products/mobile/)
- News & Insights
- [News](https://www.imaginationtech.com/news/)
- [Resources](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=)
- [Blog](https://blog.imaginationtech.com/)
- [Events](https://www.imaginationtech.com/events/)
- [Webinars](https://www.imaginationtech.com/webinars/)
- [The Future of Automotive](https://www.imaginationtech.com/future-of-automotive/)
- [University Programme](https://university.imgtec.com/)
[linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics)
© Imagination Technologies Limited. All rights reserved.
- [Privacy Policy](https://www.imaginationtech.com/privacy/)
- [Use of Cookies](https://www.imaginationtech.com/cookies/)
- [Terms of Use](https://www.imaginationtech.com/terms/)
- [Trademarks](https://www.imaginationtech.com/trademarks/)
- [Quality Policy](https://www.imaginationtech.com/quality-policy/)
[linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics)