Extensive experiments in simulation show that AVLMaps enable zero-shot multimodal goal navigation from multimodal prompts and provide 50% better recall in ambiguous scenarios.
These capabilities extend to mobile robots in the real world - navigating to landmarks referring to visual, audio, and spatial concepts.,In the context of navigation, we show that AVLMaps enable robot systems to index goals in the map based on multimodal queries, e.g., textual descriptions, images, or audio snippets of landmarks.
In particular, the addition of audio information enables robots to more reliably disambiguate goal locations.,In the context of navigation, we show that AVLMaps enable robot systems to index goals in the map based on multimodal queries, e.g., textual descriptions, images, or audio snippets of landmarks.
In particular, the addition of audio information enables robots to more reliably disambiguate goal locations.
Subarea of robotics
Robotic sensing is a subarea of robotics science intended to provide sensing capabilities to robots.Robotic sensing provides robots with the ability to sense their environments and is typically used as feedback to enable robots to adjust their behavior based on sensed input.Robot sensing includes
- The ability to see
- Touch
Hear and move and associated algorithms to process and make use of environmental feedback and sensory data.Robot sensing is important in applications such as :
- Vehicular automation
- Robotic prosthetics
- And for industrial
- Medical
Entertainment and educational robots.
