DOCUMENT
1/1
A volumetric display for visual, tactile and audio presentation using acoustic trapping
journal contribution
posted on 2023-06-09, 19:17 authored by Ryuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, Sriram SubramanianScience-fiction movies such as Star Wars portray volumetric systems that not only provide visual but also tactile and audible 3D content. Displays, based on swept volume surfaces, holography, optophoretics, plasmonics, or lenticular lenslets, can create 3D visual content without the need for glasses or additional instrumentation. However, they are slow, have limited persistence of vision (POV) capabilities, and, most critically, rely on operating principles that cannot also produce tactile and auditive content. Here, we present for the first time a Multimodal Acoustic Trap Display (MATD): a mid-air volumetric display that can simultaneously deliver visual, auditory, and tactile content, using acoustophoresis as the single operating principle. Our system acoustically traps a particle and illuminates it with red, green, and blue light to control its colour as it quickly scans through our display volume. Using time multiplexing with a secondary trap, amplitude modulation and phase minimization, the MATD delivers simultaneous auditive and tactile content. The system demonstrates particle speeds of up to 8.75m/s and 3.75m/s in the vertical and horizontal directions respectively, offering particle manipulation capabilities superior to other optical or acoustic approaches demonstrated to date. Beyond enabling simultaneous visual, tactile and auditive content, our approach and techniques offer opportunities for non-contact, high-speed manipulation of matter, with applications in computational fabrication and biomedicine.
Funding
Interactive Technologies Using Metamaterials; G2349; ROYAL ACADEMY OF ENGINEERING (BEIS); CIE1718\14
User Interaction with self-supporting free-form physical objects; G1747; EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCIL; EP/N014197/1
Levitation with localised tactile and audio feedback for mid-air interactions; G1987; Horizon 2020 research and innovation programme; Grant number 737087
History
Publication status
- Published
File Version
- Accepted version
Journal
NatureISSN
0028-0836Publisher
Nature Publishing GroupExternal DOI
Issue
7782Volume
575Page range
320-323Department affiliated with
- Informatics Publications
Research groups affiliated with
- Centre for Computer Graphics Publications
Notes
View a video representation of this paper at: https://www.youtube.com/watch?v=Tm8JRlJ1q50Full text available
- Yes
Peer reviewed?
- Yes