Navigation überspringen ([Alt] + [0])

Sitemap | english Version

>> Ressourcen > Theses > Hollosi Arno, A[..] > HTML Version > 2.9 MUSLI as Su[..]

• Über uns
  • Mitarbeiter
  • Aktuelles
  • ... mehr über uns
  • Kontaktinformationen
• Lehre
  • Lehrveranstaltungen
  • LV-Unterlagen
  • Offene Projekte
  • NEU: offene Diplomarbeiten
  • Abschlussarbeiten
• Forschung
  • Forschungsbereiche
  • Projekte
  • Publikationen
  • Partner

• Fakultät f. Informatik
• TU Graz
• TUGonline
• Impressum

2.9 MUSLI as Suggested by Lennon and Maurer

MUSLI - a multi-sensory language interface - was first proposed by Maurer and Lennon in 1994 [LM94,Len94]. MUSLI is a language of dynamic abstract symbols using multiple, hyper-linked media types and aims at more efficient creation and consumption of information.

2.9.1 Introduction

The information age poses the problem that people are overwhelmed by vast amounts of information. Keeping up to date, even in very specific areas, becomes increasingly difficult if not impossible. Although the introduction of hyper-text and advanced search mechanisms are a partial remedy of the situation, they can not be considered the final solution. What is needed is an information medium that allows everyone to scan information like very good speed readers do.

MUSLI addresses this problem by introducing dynamic abstract symbolism into hypermedia technology, allowing efficient expression and reception. The language was designed with asynchronous communication in mind, but it is not limited to this area. At first sight, MUSLI may look like an animated cartoon, but it is not - it requires an initial investment of effort to learn the symbols.

MUSLI makes use of a broad range of media like computer graphics (2D and 3D), audio clips, speech, photographs, and animations. Because of their dynamic nature MUSLI documents are often referred to as movies. Users have the ability to stop the movie anytime, display additional information, start, rewind, fast forward, review, and resume at will.

2.9.2 Abstraction and Condensing

Abstraction is a very important notion within MUSLI. In MUSLI users can choose the proportion and level of abstraction to fit their individual needs. By using an abstract but coherent set of symbols MUSLI achieves not only efficient comprehension, but also that the key idea or concept behind the symbol is not overloaded with the connotations of the symbol representation itself. However, users may always investigate these symbols further in order to familiarize themselves with the symbols' meanings.

Condensing a group of symbols into a single element is another key feature of MUSLI. Figure 2.22 shows an example. Condensing allows to introduce short forms for common concepts and help to avoid cluttering the display. An additional benefit is that users can expand condensed symbols at any time to investigate their original meaning. Condensing and expanding does not only help new users to find their way in MUSLI , but also is an essential corner stone for fast, efficient scanning of information as it gives users significant control over information presented.

More significantly, users will be able to skim condensed versions of a document, searching for relevant sections, before decomposing the symbols to display pertinent information. With facilities such as these, it may be possible to speed-read MUSLI documents faster than printed text. [LM94]

Figure 2.22: Condensing a group of symbols into a single element

2.9.3 Structure, Grammar, and Animation

MUSLI's symbols share common design principals as shown in Figure 2.23. Coherent symbol design is essential for fast comprehension and scanning of information. Also, it makes learning the language easier as some notions of the object behind the symbol can be guessed with good accuracy.

Figure 2.23: Underlying Concept of a Set of MUSLI Symbols

Based on Halliday's ``An Introduction to Functional Grammar'' [Hal85] MUSLI's grammar is grammar is built on the three most common types of processes: material processes, mental processes, and relational processes.

Material processes - processes of doing These processes have the common ``Actor, Process, Goal'' construct which is easy to animate. For example, such processes are walk, run, jump, dance, make, break, give, take, ...

Mental processes - processes of sensing These processes can be regarded as directed actions and are indicated by dynamic lines or arrows. An example given in [LM94] is love, which can be visualized as golden shaft directed towards an object. Fear or worry could be realized by using shagged shafts of a different color.

Relational processes - processes of being Processes of being can be divided into two classes: attributes of an object and states of an object. Lennon and Maurer suggest that attributes are denoted by associated symbols next to the object, whereas states of an object change shape features of the object such as color, line width, line style, and size.

Attributes modify other symbols and specify them further. This concept fits Wijngaarden's definition of orthogonality, meaning that features carry across from one context to another [vW65]. Figure 2.24 provides an example.

Figure 2.24: Orthogonality: attribute ``medical'' and base object ``building''

An important aspect of MUSLI is the animation of symbols - they can move and change with time. Furthermore the symbols itself may be animations instead of static graphic pictures. As shown in Figure 2.25 flying can be shown by an animated icon showing a bird flapping its wings. Attributes may change with time - for example growing older could be shown by increasing the line width of the object step by step. Another example of animation is morphing symbols. For example during a MUSLI movie the main character's attribute might morph from `immature' into the symbol for `sophisticated' as she gains experience.

Figure 2.25: Animated symbols: flying, growing older

2.9.4 Alternative Representations of Objects

As already discussed, MUSLI not only supports graphic symbols, but any type of media suitable for storing in digital form. This allows objects to have multiple representations. User can choose not only among different media types, but also about the abstraction level of the representation. Figure 2.26 gives an example.

Figure 2.26: Multiple representations of an object [Len95]

This level of choice makes it possible to tailor MUSLI documents to suit users' individual differences and styles. This is especially important in learning environments as different learning styles can be supported easily. Also, this gives authors of documents the chance to adjust the level of abstraction or concreteness to the situation at hand and helps users to retain their power of imagination - thereby unifying the advantages of word and picture. It will also be possible to view these alternative views simultaneously as shown in Figure 2.27. Since documents might contain deliberate ambiguous meanings these could be a fascinating way of comprehending the author's message.

Figure 2.27: Simultaneously playing different views of the same MUSLI document [Len95]

2.9.5 Applications

MUSLI can be applied in a wide range of applications. We already mentioned that it is ideally suited for learning environments, as it allows students to tailor lessons to their individual needs. This is important as it is well known that people apply different learning styles while aquiring knowledge. Let us have a look at some more fields.

2.9.5.0.1 Helping people with disabilities

Today it is widely accepted that computers help people overcome the obstacles of their disability. Languages such Minspeak were created for exactly this purpose. Provision of interactive material for communication and entertainment which takes disabilities into account is essential. MUSLI is well suited for this task, because of its distinctive approach to representing information. Currently, most applications are just dictionaries of static symbols with little room for creative play.

MUSLI takes these dictionaries a step further. It is possible to hyperlink entries, animate them, add custom symbols, and generate individual movies with a minimum of interaction. Figure 2.28 shows an example taken from Lennon's paper ``Mental Imagery and Visualisation'' [Len95]: a MUSLI editor using Bliss symbolics.

Figure 2.28: MUSLI editor using Bliss symbolics [Len95]

2.9.5.0.2 MUSLI as story-boarding tool

MUSLI has obvious potential as tool for writing story-boards. Each scene can be represented by an animated sequence and it will be possible to attach further information to elements within the MUSLI movie. Such information could be notes about costumes, the dialog, set design, photograph of real props, annotations in form of digitized speech, ...By creating different views of the same MUSLI movie every person working on the movie can retrieve information related to their work without going through the notes related to other's people work. Figure 2.29 shows a view of an interactive, annotated MUSLI movie.

Figure 2.29: Interactive, annotated MUSLI movie [Len95]

Additional features like an interactive path summary using thumbnail representations of each scene, list of actors and appearance in scenes, and list of costumes for each actor can be added easily. A full fletched implementation of a MUSLI tool like this could make traditional story-boards obsolete. Of course, the story board could become an artistic product in its own right.

2.9.5.0.3 MUSLI as learning-to-read tool

Some remedial reading teachers have expressed their interest in MUSLI as well. For example, students who have achieved reading a passage of text often enjoy drawing the story line using a series of symbolic diagrams. With MUSLI they can give way to their creative impulses and play with the story, perhaps even giving it a different ending. MUSLI provides an environment which allows to select from a range of predefined symbols, animate them, or add own symbols to play with. The ease with which this can be done does not hinder the child's imagination - quite the contrary is the case. Again, using abstract symbols leaves room for own ideas and exploration.

2.9.6 Summary

MUSLI is a multi-sensory environment, taking advantage of different media types such as graphics, sound clips, digitized speech, and animation. MUSLI uniquely addresses the need for individualized presentation of information by providing alternative representations of objects and by introducing the concept of condensing resp. expanding group of objects.

MUSLI uses abstract dynamic symbols. This not only leaves room for imagination, but is also well suited for skimming through a large amount of information. Its inherent interactive nature, its easy yet powerful interface, and its framework design make it a good choice for a wide range of applications such as story-boarding tool, learning tool, or communication tool for people with disabilities.