A B C D E F G H I J K L M N O P Q R S T U V W X Y Z all

3d audio project full details

Champion: John Domingue
Professor of Computer Science Email Icon Website Icon RDF Icon
Twitter Icon Facebook Icon LinkedIn Icon SlideShare Icon

Share:

3D Audio

3-Dimensional Audio Virtual Environments

The current state of the art in digital audio and desktop computing means that the real-time generation of rich audio virtual environments (AVEs) is now possible. Work is ongoing towards the application of such AVEs within education, with a key target group being blind students.

The overall objectives for the research are:

- To provide the foundation scientific and technical research needed to enable the development of a system, for an educational context, that facilitates the computer generation of 3-dimensional AVEs.

- To demonstrate and evaluate the application of 3D AVEs in giving access for people with a visual impairment to current and emerging approaches in educational multi-media and computer based learning.

Audio Virtual Environments

Much promise has been held up, and some demonstrated, for the application of virtual worlds in education. The ability to learn through exploring worlds that would be otherwise inaccessible because of their size, location, time-scale or dangerous nature is attractive and offers potential benefit at all levels of education. This has applications in a wide range of subject areas; a few examples could include:

- exploration of atomic structures, the solar system, or observation of magnetic field patterns

- hypermedia stories and social or language learning scenarios

- exploration within the human body, intracellular processes, bio-tech procedures

- staged development of practical skills

Now if this approach and its associated benefits is to be extended to visually impaired sighted students then the creation of rich audio virtual worlds that faithfully convey what is conventionally offered in the visual medium is needed. There is still much basic research towards the practical implementation of such audio worlds. This is particularly the case as the target is that these implementations will be readily achieved in the classroom or student's home with minimal specialised and only relatively low cost computing and audio facilities. This is the context of an ongoing collaborative work between the Multi-media and Enabling Technology Group at the Open University and the Sensory Disabilities Research Unit at the University of Hertfordshire.

Advances in Human Computer Interaction

The creation of rich audio virtual environments also presents the opportunity of realising audio user interfaces with comparable complexity and utility to standard GUIs. Thus the approach holds the potential of enhanced access to the ubiquitous GUI based software for sight impaired computer users. Thus the work has implications far beyond educational applications of virtual environments.

The researchers maintain that is not appropriate to just translate the metaphors common in GUIs (i.e. the desk top/office metaphor spatially arranged according to the limits of the VDU) to an audio representation of the same. Vision is a spatially dominant sense, where as hearing is predominantly temporal and the spatial acuity of the 2 modalities is very different. Recognising these issues empirical work is to be undertaken to evaluate alternative metaphors with the aim of improving the human computer interaction especially for visually impaired people.

News

04 Aug 2021

Kiran Parmar


View By

Research Themes

Latest Seminar
Dr Nirwan Sharma
Knowledge Media Institute, The Open University

Designing Dialogic Human-AI interfaces to further Citizen Science practice.

Watch the live webcast

CONTACT US

Knowledge Media Institute
The Open University
Walton Hall
Milton Keynes
MK7 6AA
United Kingdom

Tel: +44 (0)1908 653800

Fax: +44 (0)1908 653169

Email: KMi Support

COMMENT

If you have any comments, suggestions or general feedback regarding our website, please email us at the address below.

Email: KMi Development Team