--- title: Imagination’s neural network accelerator and Visidon’s denoising algorithm prove to be perfect partners - Imagination description: Imagination and Visidon collaborate on accelerating algorithms that denoise images without losing detail on neural network accelerators. image: https://blog.imaginationtech.com/hubfs/Imported_Blog_Media/shutterstock_453232675.jpg --- [![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Header%20Logo%20White.svg) ![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Header%20Logo%20Black.svg)](https://blog.imaginationtech.com/) - [Products & Solutions](https://www.imaginationtech.com/products/) - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - [Developers](https://developer.imaginationtech.com/) - [News & Insights](https://www.imaginationtech.com/news/) - [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=) - [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [University Programme](https://university.imgtec.com/) - [中文社区](http://imgtec.eetrend.com/) - [Company](https://www.imaginationtech.com/about/) - [About Us](https://www.imaginationtech.com/about/) - [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Leadership Team](https://www.imaginationtech.com/leadership/) - [Contact Us](https://www.imaginationtech.com/contact-us/) - [Careers](https://www.imaginationtech.com/careers/) - [Work at Imagination](https://www.imaginationtech.com/careers/) - [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/) - [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/) - [Early Careers](https://www.imaginationtech.com/careers/early-careers/) - [Search Jobs](https://www.imaginationtech.com/careers/vacancies/) - [Products & Solutions](https://www.imaginationtech.com/products/) - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - [Developers](https://developer.imaginationtech.com/) - [News & Insights](https://www.imaginationtech.com/news/) - [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=) - [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [University Programme](https://university.imgtec.com/) - [中文社区](http://imgtec.eetrend.com/) - [Company](https://www.imaginationtech.com/about/) - [About Us](https://www.imaginationtech.com/about/) - [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Leadership Team](https://www.imaginationtech.com/leadership/) - [Contact Us](https://www.imaginationtech.com/contact-us/) - [Careers](https://www.imaginationtech.com/careers/) - [Work at Imagination](https://www.imaginationtech.com/careers/) - [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/) - [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/) - [Early Careers](https://www.imaginationtech.com/careers/early-careers/) - [Search Jobs](https://www.imaginationtech.com/careers/vacancies/) × [AI](https://blog.imaginationtech.com/tag/ai) ## Imagination’s neural network accelerator and Visidon’s denoising algorithm prove to be perfect partners ![Picture of Tim Atherton](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/tim-atherton.jpg?width=60&name=tim-atherton.jpg) By [Tim Atherton](https://blog.imaginationtech.com/author/tim-atherton) Aug 23, 2021  |  3 min read - 23 August 2021 - [Tim Atherton](https://blog.imaginationtech.com/author/tim-atherton) This blog post is a result of a collaboration between [Visidon](https://www.visidon.fi/), headquartered in Finland and Imagination, based in the UK. Visidon is recognised as an expert in algorithms for camera image enhancement and analysis and Imagination has a series of [world-beating neural network accelerators](https://www.imaginationtech.com/products/ai/) (NNA) with performance up to 100 TOPS per second per core. The problem tackled in this blog post is denoising images from conventional colour cameras. The solution is in two parts: - Algorithms that remove the noise without damaging image detail. - A high-performance convolution engine capable of running a trained neural network that takes a colour image as input and outputs a denoised colour image.   ![Visidon neural network](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/VisidonNetwork-223x1024.png?width=223&height=1024&name=VisidonNetwork-223x1024.png) **An example of a Visidon deep neural network** he process of denoising images has a long history. The way modern CMOS imagers work can be thought of as an array of photon counters. Photons arrive at the sensor at an average rate: fewer in dark regions with relatively high fluctuations, but more in brighter regions with relatively lower fluctuations, i.e., better signal-to-noise ratio. The fluctuations are the noise (with Poisson statistics) due to the physics of light and cannot, in general, be avoided. We can, however, remove the noise with further processing. The key thing is to do this without damaging the picture content. Over the years many solutions have been proposed. These include simply blurring a picture slightly, sophisticated approaches with a bilateral filter, Beltrami filters based on manifold theory, scale-space Kalman filters, etc. The interesting points about denoising are firstly that noise is most obvious (to us) in flat regions of an image and noise is less visible (to us) near edges. Edges, though, are most likely to be blurred or damaged in some other way by many denoising algorithms. Damaged edges are as bad perceptually as noise! Visidon has created a convolutional neural network model (adjacent) that achieves exactly the required objectives – remove noise and simultaneously preserve edges in colour images. Imagination’s Series4 multi-core NNA’s provide a high-performance compute solution when executing Visidon’s denoising network, and at the same time, are best-in-class for low power and low area. An example set of results is shown in Figure 1. All images used in this work were 4,096 by 3,072. This image has bright white and blue lights on a dark night-time background; the original is shown in Figure 1a and the RMS error for each pixel x100 in Fig. 1b. The error is taken between a floating-point result from the network and a result generated by quantising the network to 16 bits and running the network on Imagination’s [NNA](https://www.imaginationtech.com/glossary/nna/). Figure 1 (below) shows a particularly difficult image – nevertheless, the maximum difference in any 8-bit colour channel is +/-1.  We also show (Fig. 1c) crops of the original noisy image, d) output from the floating-point network, e) the quantised network and f) a result provided by Visidon’s floating-point implementation of the network. There is no colour distortion, the noise is effectively eliminated, and the edges remain undamaged. ![Visidon fig1 ](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/visidon_fig1-Large-717x1024.png?width=717&height=1024&name=visidon_fig1-Large-717x1024.png) **Figure 1. An example “difficult” image.**In the ten example images we have looked at, all the results follow a similar pattern. In the daylight scene shown in Figure 2, no errors beyond +/- 1 per pixel per colour channel occurred. Noise in this image is less obvious but we have chosen crops to demonstrate that the denoising does not create artefacts at edges of any colour. ![Visidon fig2](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/visidon_fig4-Large-717x1024.png?width=717&height=1024&name=visidon_fig4-Large-717x1024.png) **Figure 2. Daylight scene with no edge or colour distortion** In the next image, (Figure 3), we show a brightly lit test chart. Again, there were no errors larger than +/- 1 and the detailed crops show the lack of edge artefacts that are a characteristic of Visidon’s algorithm. ![Visidon fig3](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/visidon_fig5-Large-717x1024.png?width=717&height=1024&name=visidon_fig5-Large-717x1024.png) **Figure 3. Visidon Results: Brightly-lit test chart.** The final image result, (Figure 4), shows a test chart taken in low light – another very difficult image. Here, we clearly see the noise (the signal-to-noise ratio for data with Poisson statistics gets worse as the mean level decreases). In the detail of the original image (Fig. 6c) the severe colour noise is obvious in both the brighter and darker regions. This is a consequence of the uncorrelated fluctuations in the separate red, green, and blue channels producing random variations in colour (approximately Rician statistics in three dimensions). Visidon’s denoising algorithm eliminates the noise in the luma (brightness) and chroma (colour) whilst simultaneously preserving the edges. Remarkably, there is no discernible difference between the floating-point results from the network and the 16-bit quantised results from the network and again the maximum difference between these two results is +/-1 at any pixel and any colour channel. ![Visidon fig4](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/visidon_fig6-Large-717x1024.png?width=717&height=1024&name=visidon_fig6-Large-717x1024.png) Figure 4. Visidon Results: Low-light test chart.   **IMG Series4 multi-core** ![Visidon Figure 6](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/visidon_fig3-1024x687.png?width=1024&height=687&name=visidon_fig3-1024x687.png) **Figure 5. Schematic of an IMG 4NX-MC8** The IMG 4NX-MC8 in Figure 5, has advanced architecture features and comes in a range of multi-core versions. The 4NX-MC1 has a single core capable of up to 12.5 TOPS (1 TOPS = 1 Tera operations per second). The performance of Imagination’s 4NX-MC1, 4NX-MC4 and 4NX-MC6 cores are shown in Table 1 below. ![Series4 NNA inf/sec](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/inference_sec.jpg?width=422&height=312&name=inference_sec.jpg)**Table 1. Performance and configuration of Imagination NNA cores on the Visidon Denoising network generated with Imagination’s standard toolchain** ## Conclusion To summarise, this is a very interesting example of a deep-convolutional neural network that produces an image as output from an image as input. The performance in terms of image quality is remarkable because denoising is a difficult problem when dealing with high-quality images. The fidelity of the results reflects the quality of Visidon’s algorithm and in particular their choice of network architecture and the way it has been trained. It also demonstrates very clearly that a quantised network, in this case, 16-bits, can give results near-identical to a floating-point network. It is worth mentioning here that we did look at lower bit depths. The errors in most neural networks will increase a little when executed in 8-bits. Depending on the application a small increase in error might be acceptable. In the context of high-quality image enhancement, a very small error becomes visible to a human observer. Banding in flat regions was evident with 8-bit data (activations) and colour distortion was evident with 8-bit weights. Running the network with 16-bit data and 16-bit weights leaves no visible artefacts at all and differences are +/- 1 in any pixel and colour in the output images. By running Visidon’s denoising network, the performance of Imagination’s NNA demonstrates its capability beyond conventional AI applications and its applicability to image enhancement. *This post was written by Tim Atherton, Director of Research in AI at Imagination and made possible by the work of James Imber, Research Manager, IMG Labs, Imagination.* [AI](https://blog.imaginationtech.com/tag/ai) #### Share this post - - [mailto:?subject=https://blog.imaginationtech.com/imaginations-neural-network-accelerator-and-visidons-denoising-algorithm-prove-to-be-perfect-partners/](mailto:?subject=https://blog.imaginationtech.com/imaginations-neural-network-accelerator-and-visidons-denoising-algorithm-prove-to-be-perfect-partners/) ##### About the Author ![Picture of Tim Atherton](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/tim-atherton.jpg?width=60&name=tim-atherton.jpg) [Tim Atherton](https://blog.imaginationtech.com/author/tim-atherton) Tim is the Director of Research at IMG Labs for Imagination Technologies. [More from Tim Atherton](https://blog.imaginationtech.com/author/tim-atherton) ### Subscribe to our blog ### Introducing E-Series GPU Imagination E-Series GPU IP breaks through the barriers of throughput, memory, and power at the edge.Built for next-gen AI, E-Series delivers high performance and adaptability across mobile, automotive, desktop, and consumer markets, avoiding the rigidity of fixed-function accelerators while retaining the flexibility of GPU programmability. [Learn more](https://www.imaginationtech.com/products/e-series/) ### Read Next [![](https://blog.imaginationtech.com/hubfs/HubSpot%20Blog%20Header.png)](https://blog.imaginationtech.com/from-prototype-to-performance-optimizing-opencv-resize-on-volcanic-gpus) ## [From Prototype to Performance: Optimizing OpenCV Resize on Volcanic GPUs](https://blog.imaginationtech.com/from-prototype-to-performance-optimizing-opencv-resize-on-volcanic-gpus) [AI](https://blog.imaginationtech.com/tag/ai) [GPU](https://blog.imaginationtech.com/tag/gpu) 6 min read This is a practitioner-oriented prototype case study. It focuses on implementation and optimization... [Read more](https://blog.imaginationtech.com/from-prototype-to-performance-optimizing-opencv-resize-on-volcanic-gpus) [![voice assistant on phone](https://blog.imaginationtech.com/hubfs/AdobeStock_1830810279.jpeg)](https://blog.imaginationtech.com/llm-performance-and-acceleration-on-powervr-part-2) ## [LLM Performance and Acceleration on PowerVR - Part 2](https://blog.imaginationtech.com/llm-performance-and-acceleration-on-powervr-part-2) [AI](https://blog.imaginationtech.com/tag/ai) [GPU](https://blog.imaginationtech.com/tag/gpu) 3 min read Part 2: Recap Welcome to the second part of this two-part blog series about how to accelerate large... [Read more](https://blog.imaginationtech.com/llm-performance-and-acceleration-on-powervr-part-2) [![](https://blog.imaginationtech.com/hubfs/Untitled%20design%20(4).png)](https://blog.imaginationtech.com/running-opencode-with-llama.cpp-and-qwen-3.5-on-e-series) ## [Running OpenCode with llama.cpp and Qwen 3.5 on E-Series](https://blog.imaginationtech.com/running-opencode-with-llama.cpp-and-qwen-3.5-on-e-series) [AI](https://blog.imaginationtech.com/tag/ai) [Software](https://blog.imaginationtech.com/tag/software) 5 min read Edge AI gets more interesting when a model does more than answer prompts. It plans, calls tools,... [Read more](https://blog.imaginationtech.com/running-opencode-with-llama.cpp-and-qwen-3.5-on-e-series) - Products - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Open Access](https://www.imaginationtech.com/products/open-access/) - [Design Optimization Kit](https://www.imaginationtech.com/products/design-optimisation-kit/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - Developers - [Developers](https://developer.imaginationtech.com/) - [PowerVR SDK and Tools](https://developer.imaginationtech.com/powervr-sdk/) - [Developer Downloads](https://developer.imaginationtech.com/downloads/) - [Developer Documentation](https://docs.imgtec.com/) - [Developer Forums](https://forums.imgtec.com) - About Imagination - [About Us](https://www.imaginationtech.com/about/) - [Career Opportunities](https://www.imaginationtech.com/careers/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Imagination Leadership](https://www.imaginationtech.com/leadership/) - [Contact Imagination](https://www.imaginationtech.com/contact-us/) - Applications - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - News & Insights - [News](https://www.imaginationtech.com/news/) - [Resources](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [The Future of Automotive](https://www.imaginationtech.com/future-of-automotive/) - [University Programme](https://university.imgtec.com/) [linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics) ![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Footer%20Logo.svg) © Imagination Technologies Limited. All rights reserved. - [Privacy Policy](https://www.imaginationtech.com/privacy/) - [Use of Cookies](https://www.imaginationtech.com/cookies/) - [Terms of Use](https://www.imaginationtech.com/terms/) - [Trademarks](https://www.imaginationtech.com/trademarks/) - [Quality Policy](https://www.imaginationtech.com/quality-policy/) [linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics)