From KNOW-HOW to WOW Robert Bosch GmbH

Prompt battle! We've all tried giving generative AI chatbots instructions that yield useful results. Recently, GenAI has rapidly expanded across various industries. But can it help drive a car? Dr. Liu Ren, Vice President and Chief Scientist for scalable and assistive AI at Bosch Research, is confident it can. He and his team are at the forefront of integrating foundation models such as large language models or vision-language models with advanced driver assistance systems (ADAS). In this episode, Liu explains to our hosts, Shuko and Geoff, how the extensive knowledge contained in foundation models can enhance the perception, prediction, and planning capabilities of ADAS. What's even more impressive is that Bosch Research’s approach works despite the constrained resources typical in vehicle environments. As Liu shares his cutting-edge research, Shuko and Geoff go head-to-head in a challenge: Who can craft the cleverest prompts for GenAI?

Credits:
1. Chenbin Pan, Burhan Yaman, Tommaso Nesti, Abhirup Mallik, Alessandro G Allievi, Senem Velipasalar, Liu Ren. “VLP: Vision Language Planning for Autonomous Driving”, The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024).
2. Xiaoqi Wang, Wenbin He, Xiwei Xuan, Clint Sebastian, Jorge Henrique Piazentin Ono, Xin Li, Sima Behpour, Thang Doan, Liang Gou, Han Wei Shen, Liu Ren. “USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentation” , The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024).
3.Chenbin Pan, Burhan Yaman, Senem Velipasalar, Liu Ren. “CLIP-BEVFormer: Enhancing Multi-View Image-Based BEV Detector with Ground Truth Flow”, The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024).

More Bosch podcasts:
From Know-how to Wow with Liu Ren, all about “Visual Analytics”: https://www.youtube.com/watch?v=CmR97fW_B3I
Beyond Bosch:
https://podtail.com/de/podcast/beyond-bosch/

The OGS, the Optical Gas Spectrometer, is a feat of engineering. In the previous episode, we discussed what it can do and how it works. Today, Bosch associate and OGS inventor Alex Stratmann talks more about turning Raman spectrometers into an industrial product. Many considerations had to be made, from the custom laser source to the material used for the seals, and we also learn that OGS development hasn't stopped: The team is working on a high-pressure version and on efforts to measure almost any gas in the world.

More Bosch podcasts:
Previous episode:
https://fromknowhowtowow.podigee.io/65-optical-gas-spectrometer
Beyond Bosch:
https://podtail.com/de/podcast/beyond-bosch/

Take a deep breath. What you just breathed in was probably about 78% nitrogen and 21% oxygen and some minor other components. But how do you measure that? Measuring gases and their concentrations has been pretty difficult, says Bosch physicist Alex Stratmann. His team’s invention, the optical gas spectrometer, OGS, is set to change that. It packs what used to be a complex lab setup into a tabletop device. OGS leverages Raman spectroscopy, a method that exists for about a 100 years and has been used e.g. in the art world to analyze pigments. Our hosts Melena and Shuko learn from Cristina Aibéo, a chemist at Berlin’s National Museums, how Raman spectroscopy can help solve crimes and also save energy. At Bosch, on the other hand, the OGS helps with measuring hydrogen - and thus with the transition to a green hydrogen economy. Breathe in, breathe out, hit play!

From Know-how to Wow”: How to produce green hydrogen?
https://www.youtube.com/watch?v=fvbHOY7GAig

Bosch’s interior sensing solutions for vehicles can include a driver and/or occupant-monitoring camera, along with an interior radar. All three have distinct capabilities but together they enable not only reliable safety features, but also new comfort features. Bosch product manager Tyler Warga shares details about how the system works and how it handles difficult situations like changing light conditions or obstructions, e.g. sunglasses. Per usual, your host is Geoff’s voice avatar.

More Bosch podcasts:
Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

You’re driving in your car, you notice a new restaurant as you drive past and you wonder: What was that? A car of the not-so-distant future may be able to answer that question. Because it knows what a driver (or passenger) is looking at - be it a landmark on the side of the road, the dashboard, or the road ahead. In the first place, monitoring the driver's gaze and head position enables important safety features, says Bosch product manager Tyler Warga. Geoff and Shuko learn how cameras and radar sensors can pick up signals that people are subconsciously sending. This can help prevent drunk driving, reduce distractions, and save children's lives. Future autonomous cars could even benefit from a sense of the driver's emotional state: they could pick up on Duchenne smiles. As University of Missouri professor Kennon Sheldon explains, this type of smile signals honest amusement. So be amused and wowed when you join us for a sensor-packed ride!

More Bosch podcasts:
Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Today, artificial intelligence is often synonymous with neural networks. But they're not always the smartest choice. Daniel Jung of Bosch Sensortec in Sweden explains why the Smart Connected Sensors technology platform uses a different kind of AI. He also reveals some other tricks that make the Smart Connected Sensors efficient and reliable. Your host, as usual for our deep dive episodes, is Geoff's voice avatar.

More Bosch podcasts:
Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/