--- title: Making surround-view for cars smarter and safer - Imagination description: Check out our demo of how we can enhance surround-view with the addition of accurate real-time reflections and AI to detect hazards that make the car safer. image: https://blog.imaginationtech.com/hubfs/Imported_Blog_Media/3D_model.png --- [![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Header%20Logo%20White.svg) ![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Header%20Logo%20Black.svg)](https://blog.imaginationtech.com/) - [Products & Solutions](https://www.imaginationtech.com/products/) - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - [Developers](https://developer.imaginationtech.com/) - [News & Insights](https://www.imaginationtech.com/news/) - [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=) - [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [University Programme](https://university.imgtec.com/) - [中文社区](http://imgtec.eetrend.com/) - [Company](https://www.imaginationtech.com/about/) - [About Us](https://www.imaginationtech.com/about/) - [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Leadership Team](https://www.imaginationtech.com/leadership/) - [Contact Us](https://www.imaginationtech.com/contact-us/) - [Careers](https://www.imaginationtech.com/careers/) - [Work at Imagination](https://www.imaginationtech.com/careers/) - [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/) - [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/) - [Early Careers](https://www.imaginationtech.com/careers/early-careers/) - [Search Jobs](https://www.imaginationtech.com/careers/vacancies/) - [Products & Solutions](https://www.imaginationtech.com/products/) - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - [Developers](https://developer.imaginationtech.com/) - [News & Insights](https://www.imaginationtech.com/news/) - [Newsroom](https://www.imaginationtech.com/news/?query=news&filter-language=english&filter-search=) - [Resources Hub](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [University Programme](https://university.imgtec.com/) - [中文社区](http://imgtec.eetrend.com/) - [Company](https://www.imaginationtech.com/about/) - [About Us](https://www.imaginationtech.com/about/) - [Diversity, Equity and Inclusion](https://www.imaginationtech.com/diversity-equity-and-inclusion/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Leadership Team](https://www.imaginationtech.com/leadership/) - [Contact Us](https://www.imaginationtech.com/contact-us/) - [Careers](https://www.imaginationtech.com/careers/) - [Work at Imagination](https://www.imaginationtech.com/careers/) - [Life at Imagination](https://www.imaginationtech.com/careers/life-at-imagination/) - [Hybrid Working](https://www.imaginationtech.com/careers/hybrid-working/) - [Early Careers](https://www.imaginationtech.com/careers/early-careers/) - [Search Jobs](https://www.imaginationtech.com/careers/vacancies/) × [Automotive](https://blog.imaginationtech.com/tag/automotive) ## Making surround-view for cars smarter and safer ![Picture of Imagination Technologies](https://blog.imaginationtech.com/hs-fs/hubfs/img-logo.png?width=60&name=img-logo.png) By [Imagination Technologies](https://blog.imaginationtech.com/author/imaginationtech) Jul 9, 2020  |  2 min read - 09 July 2020 - [Imagination Technologies](https://blog.imaginationtech.com/author/imaginationtech) With modern advancements in automotive safety, we are seeing advanced driving assistance systems ([ADAS](https://www.imaginationtech.com/glossary/adas/)) such as surround-view become the new standard in modern cars. This demonstration shows how this application can be enhanced with the addition of accurate real-time reflections and AI to detect hazards that make cars safer. When this is combined with the new safety mechanisms in our new XS GPU family, it is clear why our GPUs are considered the safest in the world.     First, let’s start with the graphics problem. Have you ever looked at an existing surround-view system and thought “Why does the car look like something out of a PS1 game? – i.e. flat, dull shading. Why doesn’t it look shiny and cool and more real – and why can’t I see the surroundings?” ![stock surround-view](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/stock_surround_view-1024x683.jpg?width=1024&height=683&name=stock_surround_view-1024x683.jpg) Rest assured, we have a created an innovative solution that pushes the envelope of both visual quality and accuracy for an automotive application. Below is a screenshot from our smart surround-view demonstration that shows soft lighting and real-time reflections mapped onto the car from the surrounding environment, features which are currently non-existent in any surround-view application on the market. To be clear, what this means is that not only does the driver sees a high-quality realistic 3D model of the vehicle, but its actual surroundings are mapped onto the car – in real time. As such, the driver gets accurate feedback about their surroundings, making the surround-view feature even safer and more capable. ![surround-view 3D model](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/3D_model-1024x577.png?width=1024&height=577&name=3D_model-1024x577.png) How is this all done I hear you ask? First, the car rig captures four feeds from the cameras simultaneously, stitches them together and maps them to a hemisphere. This provides a top-down view of the car and the surroundings, which enables the driver to park their car safely and effectively. We are then able to use this hemisphere to calculate real-time reflections, that adapt to the car’s surroundings and map them onto the model of the car for an extra layer of safety, whilst truly immersing the car and driver within the environment. ![surround view bubble](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/surround_view_bubble-1.png?width=920&height=600&name=surround_view_bubble-1.png) The application in this demo runs on a relatively modest PowerVR GX6650 GPU inside the Renesas R-Car H3. When you pair this up with our dedicated [neural-network accelerator (NNA)](https://www.imaginationtech.com/glossary/nna/), the [PowerVR Series2NX AX2185](https://blog.imaginationtech.com/powervr-series2nx-raising-the-bar-for-embedded-ai/), you start to see the [benefits of our “AI Synergy”](https://blog.imaginationtech.com/taking-the-hyperlane-with-img-a-series/), where we offload complex neural network processing from the GPU onto our NNA, whilst increasing the compute utilisation of the GPU. ![surround-view demo photo](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/demo_photo-1024x576.jpg?width=1024&height=576&name=demo_photo-1024x576.jpg) This car rendering and camera stitching are performed on the GPU. A snapshot of the environment hemisphere is passed to the NNA, which then processes the image and detects objects and hazards. Once the detection pass has been completed the detected hazards are then fed back to the R-Car H3 and are composited on top of the hemisphere. ![surround-view demo photo2](https://blog.imaginationtech.com/hs-fs/hubfs/Imported_Blog_Media/demo_photo2-1024x575.jpg?width=1024&height=575&name=demo_photo2-1024x575.jpg) The hazards are detected using a neural network which is trained on a specific image set – in this case, we are using the GoogleNet Single Shot Detector (SSD) to detect people, cars and many other objects. This is only scratching the surface of what could be achieved on the AI side as we edge closer to seeing autonomous vehicles becoming the new standard. Neural networks will be pivotal in this as they can be used to enhance a range of ADAS systems such as driver monitoring and road-sign recognition. With the introduction of our [XS family of GPU for automotive](https://blog.imaginationtech.com/unveiling-xs-the-ultimate-gpu-family-for-automotive/), Imagination offers a range of functionally-safe GPUs with unique safety mechanisms that can be combined with powerful NNAs to deliver faster smarter applications across the board. Let us know what you think of this demo in the comments and to keep up to date with everything related to Imagination you can follow us on Twitter. [Automotive](https://blog.imaginationtech.com/tag/automotive) #### Share this post - - [mailto:?subject=https://blog.imaginationtech.com/making-smarter-and-safer-automotive-applications-with-imagination/](mailto:?subject=https://blog.imaginationtech.com/making-smarter-and-safer-automotive-applications-with-imagination/) ##### About the Author ![Picture of Imagination Technologies](https://blog.imaginationtech.com/hs-fs/hubfs/img-logo.png?width=60&name=img-logo.png) [Imagination Technologies](https://blog.imaginationtech.com/author/imaginationtech) Here at Imagination, our vision is to be the undisputed leader in semiconductor IP solutions that transform billions of lives. [More from Imagination Technologies](https://blog.imaginationtech.com/author/imaginationtech) ### Subscribe to our blog ### Introducing E-Series GPU Imagination E-Series GPU IP breaks through the barriers of throughput, memory, and power at the edge.Built for next-gen AI, E-Series delivers high performance and adaptability across mobile, automotive, desktop, and consumer markets, avoiding the rigidity of fixed-function accelerators while retaining the flexibility of GPU programmability. [Learn more](https://www.imaginationtech.com/products/e-series/) ### Read Next [![](https://blog.imaginationtech.com/hubfs/AdobeStock_223397823.jpeg)](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc) ## [Imagination & Chiplets: Scaling System Design Beyond the Monolithic SoC](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc) [Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu) 4 min read For many years, improvements in SoC performance came from process scaling and integrating more... [Read more](https://blog.imaginationtech.com/imagination-chiplets-scaling-system-design-beyond-the-monolithic-soc) [![ambarella-case-study-featured](https://blog.imaginationtech.com/hubfs/ambarella-case-study-featured.jpg)](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu) ## [Ambarella's CV3-AD655 Surround View with IMG BXM GPU: A Case Study](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu) [Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu) 2 min read Ambarella’s CV3-AD655 autonomous driving AI domain controller pairs energy-efficient compute with... [Read more](https://blog.imaginationtech.com/ambarellas-cv3-ad655-surround-view-with-img-bxm-gpu) [![IMG - How fast a GPU do you need... Block - Widget - 650 x 420 – 7](https://blog.imaginationtech.com/hubfs/IMG%20-%20How%20fast%20a%20GPU%20do%20you%20need...%20Block%20-%20Widget%20-%20650%20x%20420%20%E2%80%93%207.jpg)](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface) ## [How fast a GPU do you need for your user interface?](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface) [Automotive](https://blog.imaginationtech.com/tag/automotive) [GPU](https://blog.imaginationtech.com/tag/gpu) [Consumer](https://blog.imaginationtech.com/tag/consumer) 4 min read Graphical user interfaces (GUIs) are common across all walks of life, from your smartphones to your... [Read more](https://blog.imaginationtech.com/how-fast-a-gpu-do-you-need-for-your-user-interface) - Products - [GPU](https://www.imaginationtech.com/products/gpu/) - [CPU](https://www.imaginationtech.com/products/cpu/) - [AI](https://www.imaginationtech.com/products/ai/) - [Ethernet](https://www.imaginationtech.com/products/ethernet/) - [Ray Tracing](https://www.imaginationtech.com/products/ray-tracing/) - [Open Access](https://www.imaginationtech.com/products/open-access/) - [Design Optimization Kit](https://www.imaginationtech.com/products/design-optimisation-kit/) - [Product Finder](https://www.imaginationtech.com/products/catalog/) - Developers - [Developers](https://developer.imaginationtech.com/) - [PowerVR SDK and Tools](https://developer.imaginationtech.com/powervr-sdk/) - [Developer Downloads](https://developer.imaginationtech.com/downloads/) - [Developer Documentation](https://docs.imgtec.com/) - [Developer Forums](https://forums.imgtec.com) - About Imagination - [About Us](https://www.imaginationtech.com/about/) - [Career Opportunities](https://www.imaginationtech.com/careers/) - [Imagining a Sustainable Future](https://www.imaginationtech.com/imagining-a-sustainable-future/) - [Corporate Social Responsibility](https://www.imaginationtech.com/csr/) - [Imagination Leadership](https://www.imaginationtech.com/leadership/) - [Contact Imagination](https://www.imaginationtech.com/contact-us/) - Applications - [Automotive](https://www.imaginationtech.com/products/automotive/) - [Consumer](https://www.imaginationtech.com/products/consumer/) - [Desktop](https://www.imaginationtech.com/products/desktop/) - [Mobile](https://www.imaginationtech.com/products/mobile/) - News & Insights - [News](https://www.imaginationtech.com/news/) - [Resources](https://www.imaginationtech.com/resources/?query=resource&filter-language=english&filter-search=) - [Blog](https://blog.imaginationtech.com/) - [Events](https://www.imaginationtech.com/events/) - [Webinars](https://www.imaginationtech.com/webinars/) - [The Future of Automotive](https://www.imaginationtech.com/future-of-automotive/) - [University Programme](https://university.imgtec.com/) [linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics) ![Imagination](https://blog.imaginationtech.com/hubfs/Imagination_December2019%20Theme/Images/Footer%20Logo.svg) © Imagination Technologies Limited. All rights reserved. - [Privacy Policy](https://www.imaginationtech.com/privacy/) - [Use of Cookies](https://www.imaginationtech.com/cookies/) - [Terms of Use](https://www.imaginationtech.com/terms/) - [Trademarks](https://www.imaginationtech.com/trademarks/) - [Quality Policy](https://www.imaginationtech.com/quality-policy/) [linkedin](https://www.linkedin.com/company/imgtec) [twitter](https://twitter.com/imaginationtech) [youtube](https://www.youtube.com/user/Imgtec/) [github](https://github.com/powervr-graphics)