some_text Graphical Visualisation of Conversation for AAC | CDS2011


Graphical Visualisation of Conversation for AAC

Yulong Sun

Augmentative and Alternative Communication (AAC) is a field that seeks to develop systems that assist and enhance the communication abilities of those whose disabilities impair communication. The non-speaking people who relay on AAC devices to complete everyday conversations often run into problems due to the awkwardness of the interface and the impatience of the communication partner. As the size of stored information corpus in the ACC system increase, it can be very hard for the ACC users, especially those who are unfamiliar with communication skills, to find the right dialog they need. An aim of this project is to reduce the load on the AAC system user so that they can concentrate mainly on thinking about what to say rather than on how to work the system. Using graphical visualisation is an appropriate way to make information access easier for the AAC users. Presenting the conversation in a graphical interface and making the interface users picking the graphical symbol rather than searching in the ocean of text information can help to guide non-speaking person through the conversation and participate better in it. There are two prototypes of such interface came out after the first semester’s research: the map-type model and the 3D fish-motion model. The model chosen for the project is the 3D fish-motion model. 3D fish-motion model is based on cartoon fish graphic visualisation which is a very lovely and fantasy way to visualize the conversation for AAC users

Other projects

Wang Junying

Personal Narratives

Create a mobile application/interactive information point for Blood Donors

Computer Based Exam

SnapSearch: An Android Image-Based Search Engine for a Museum Environment

Towards a System of Data Management at a Gym

PET (Professionalism and Employability Toolkit)

SHERLOCK — Neural Network Software for Automated Problem Solving

Using subtitles and captions to support second language learning

A tool to investigate the quality of web accessibility evaluation measures

Quality Control Analytics for Colombian Coffee Growers

Software Control: Software Configuration Management for Rig Control and Automation Systems

The Effects of Stereoscopic 3D on Gaming Immersion: A Comparative Study of Single Image Rendering versus Stereoscopic Rendering.

Constraint Programming Research

Concept Mapping and Drupal Integration for OurDigitalCulture

Electronic Circuit design laboratory tutorial for first year students

The Memory Box

Lunar Lander Game

The Development of a Mobile Phone based Audio Interview Tool

Rover Route Planner

The coffee table of the future

SpaceWire Plug and Play

Modelling of Multi-touch computer interactions

Multitouch Application

The MWG (Multi-Touch War Game)

Watching genes in living cells using computer vision

Own project – Social Networking

Web-based Project allocation software

Asteroid Sample-Return Mission Simulator

Time Line Interface to Represent Personal Life Histories – Data Input

Ship Tracking

Social Networking and Older People

Extension of cryptography tutor

Web based tool to support successful submission to the Ethics Committee

Home Intelligence

Multitouch Music Application

RESTandra/ – A RESTful HTTP API for the distributed structured data store Cassandra

Business Intelligence for Biological Data Sets

Grok Tool

Automatic Detection of Cell Boundaries in Immunoelectron Microscopy Images

Reducing email overload

Multi-touch Argument Analysis

Increasing the Sociability & Accessibility of Online Social Networking

Map Story of Dundee Characters

LabTracker: Development of an iPad-based Laboratory Management System