From Touch to Vision: A Bioinspired Multisensory Framework Brings Human-Like Perception to Robots

Human cognition relies on the seamless integration of multiple senses, allowing the brain to associate, infer, and even imagine across modalities. Replicating this capability in artificial systems has long remained a challenge, particularly under strict energy constraints. This study presents a bioinspired multisensory framework that integrates vision, touch, hearing, smell, and taste within a self-powered architecture. By enabling cross-modal association and adaptive reconfiguration, the system allows one sensory input--such as touch or sound--to trigger corresponding representations in other sensory domains. Beyond conventional recognition, the framework demonstrates higher-level cognitive functions, including inference and generative pattern creation. These advances point toward a new generation of intelligent machines capable of human-like perception and cognition.