Autonomous Vehicle IMS
Use Case
Passenger count and status
Soon, one very challenging problem is solved and we can enjoy emission free, autonomous public transportation, for example in shuttles and robotaxis. We are working on the next challenge to keep the interior safe as well, in an automated way! Monitoring passenger count to prevent overload, detecting safe states like seated or belted and detecting behaviours or health status are only the beginning!
Why is it important to monitor the interior of AD shuttles?
Automated driving will revolutionize our mobility! Thinking about a driver (i.e. for a bus) and AD technology, driving the vehicle is not his only responsibility. He is also having an eye on the interior of the vehicle – allowing a safe travel for all occupants. This starts with the number of people in the vehicle and them being properly positioned, seated, belted, etc – depending on the vehicle type and driving scenario. Spotting dangerous behaviours, a sick person needing help and others are further important tasks. Occupant monitoring for AD vehicles helps to keep everybody safe and to manage a fleet with automated monitoring of interior.
What is occupant monitoring?
Occupant monitoring is providing information about any occupant in the vehicle. While already in the past there have been different sensor technologies for this (i.e. weight sensors) a large focus today is on getting information from cameras by means of computer vision and artificial intelligence. Cameras are being used to extract information like weight, height, body pose, gender, age, emotion, health status and more.
How does it work?
New occupant monitoring technologies focus on cameras, computer vision and artificial intelligence. By means of image analysis we extract number of people in the vehicle, seated or standing, behaviours and classification. Such information are being used in vehicle control to detect dangerous scenarios (i.e. overloaded) or alert remote fleet management control.