posted on 2023-06-09, 19:17authored byRyuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, Sriram Subramanian
Science-fiction movies such as Star Wars portray volumetric systems that not only provide visual but also tactile and audible 3D content. Displays, based on swept volume surfaces, holography, optophoretics, plasmonics, or lenticular lenslets, can create 3D visual content without the need for glasses or additional instrumentation. However, they are slow, have limited persistence of vision (POV) capabilities, and, most critically, rely on operating principles that cannot also produce tactile and auditive content. Here, we present for the first time a Multimodal Acoustic Trap Display (MATD): a mid-air volumetric display that can simultaneously deliver visual, auditory, and tactile content, using acoustophoresis as the single operating principle. Our system acoustically traps a particle and illuminates it with red, green, and blue light to control its colour as it quickly scans through our display volume. Using time multiplexing with a secondary trap, amplitude modulation and phase minimization, the MATD delivers simultaneous auditive and tactile content. The system demonstrates particle speeds of up to 8.75m/s and 3.75m/s in the vertical and horizontal directions respectively, offering particle manipulation capabilities superior to other optical or acoustic approaches demonstrated to date. Beyond enabling simultaneous visual, tactile and auditive content, our approach and techniques offer opportunities for non-contact, high-speed manipulation of matter, with applications in computational fabrication and biomedicine.
Funding
Interactive Technologies Using Metamaterials; G2349; ROYAL ACADEMY OF ENGINEERING (BEIS); CIE1718\14
User Interaction with self-supporting free-form physical objects; G1747; EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCIL; EP/N014197/1
Levitation with localised tactile and audio feedback for mid-air interactions; G1987; Horizon 2020 research and innovation programme; Grant number 737087