Symbol Builder for Autocreation of Images for Alternative and Augmentative Communication

Abstract

In many develo** countries, access to Alternative and Augmentative Communication (AAC) is limited to pictographic symbols designed to reflect languages and cultures other than that of the locality. Simple, functional communication is available, but the breadth and depth of local vocabulary is often restricted. This is usually due to the cost of customization and a lack of support necessary to create symbols in a similar style to those already offered or yet to be created for an individual with speech and language difficulties. Generative AI tools have the potential to affect the use of AAC in diverse situations and settings, by accelerating automated symbol development, supported by participatory evaluation. Symbol Builder uses AI models for image to text processes where individual symbol style descriptions are created. These captions are automatically paired with actual symbols from open licensed symbol sets. The next stage requires the provision of text prompts that engage the AI model, trained on the schema for a specific symbol set, to generate a symbol representing a new concept. The resulting image can be edited or accepted as a new pictograph which then goes through a voting process of acceptance. This is where AAC users and communication partners from the relevant linguistic and cultural setting decide if the symbols are ready to be published or require further adaptations. Finally, symbols are uploaded to a repository of open licensed AAC symbols for public use.