DFKI
Home
Selected Public Appearances
Current Work (Selection)
  VOICE Award 2006
  Project HALO 2
  GNAB
  juris
  Mobile Multimodal Systems
Recent Work (Selection)
  VOICE Award 2005
  Improved Internet Search
  WYSIWYM
  Document Manager
  Multitasking with Xybernaut
  Automatic Hyperlinking
  Speech-Based Home Cooking Assistant
  Sonicson Music Retrieval System
Equipment
  Tips and Tricks for Mobile Eye Tracking
Publications
Selected Videos
Services and Contact

German Competence Center for Speech Technology The other parts of the German Competence Center for Speech Technology:
Virtual Information Center LT-World
German Demonstration Center for LT-Systems

The COLLATE Project

Last modified: 2006-11-09

The DFKI Evaluation Center for Language Technology

 

Recent Work


 
 

WYSIWYM - What You See Is What You Meant

 
 
Screenshot WYSIWYM with eye movements

Optimizing Screen Design for Natural Language-Based Knowledge Editing

A study that is still in an early stage focuses on the system WYSIWYM, which was developed by Dr. Richard Power of the University of Brighton (see http://www.itri.bton.ac.uk/projects/WYSIWYM/wysiwym.html). The system allows an expert in a given domain to encode knowledge in a language-independent form by formulating English-language propositions with the help of a sophisticated interface that includes menus and hyperlinks. An example of a general screen design issue raised by this system is the question of when it is advisable to supply an explicit abstract label (e.g., “Pronouns” or “Noun Patterns”) for a group of expressions from which the user can select–as opposed to simply letting the expressions speak for themselves. Analyses of data from the first few subjects have shown that this is one more issue on which eye tracking can yield valuable information.

The study was performed with the ASL Model 504 remote eye tracker; see the videos recorded during the eye tracking experiment.