sensory substitution as a superpower

‘Weihenmayer climbs using a device called the BrainPort, held in his mouth; it converts one sense (sight) to another (touch).

A decade ago, Weihenmayer began using the BrainPort, a device that enables him to “see” the rock face using his tongue. The BrainPort consists of two parts: the band on his brow supports a tiny video camera; connected to this by a cable is a postage-stamp-size white plastic lollipop, which he holds in his mouth. The camera feed is reduced in resolution to a grid of four hundred gray-scale pixels, transmitted to his tongue via a corresponding grid of four hundred tiny electrodes on the lollipop. Dark pixels provide a strong shock; lighter pixels merely tingle. The resulting vision is a sensation that Weihenmayer describes as “pictures being painted with tiny bubbles.”

What’s particularly interesting, however, is that these are still just the earliest days of investment and research into what sensory-substitution devices might someday be able to achieve. 

They could lead, for example, to the creation of artificial “superabilities,” or synthetic senses that act as a mix between our existing bodily inputs. Through the use of these sorts of devices, Nicky writes, humans “may, depending on the data transmitted through their skin, be able to ‘feel’ electromagnetic fields, stock-market data, or even space weather,” or “enable us to ‘see’ bodies through walls using the infrared spectrum or to ‘hear’ the location of family members using G.P.S. tracking technology.”’