Spontaneous Catalan sign language recognition: data acquisition and classification
Spontaneous Catalan sign language recognition: data acquisition and classification
Citació
- Garmendia N, Saggion H, McGill E. Spontaneous Catalan sign language recognition: data acquisition and classification. In: Shterionov D, Sisto MD, Vanroy B, Vandeghinste V, Nyst V, Vermeerbergen M, Roelofsen F, Lepp L, Strasly I, editors. Proceedings of the Third International Workshop on Automatic Translation for Signed and Spoken Languages (AT4SSL), in the 20th Machine Translation Summit; 2025 June 23-27; Geneva, Switzerland. p 7-15.
Enllaç permanent
Descripció
Resum
This work presents the first investigation intoSpontaneous Isolated Sign Language Recog-nition for Catalan Sign Language (LSC). Our work is grounded on the derivation of a dataset of signs and their glosses from a corpus of spon-taneous dialogues and monologues. The recog-nition model is based on a Multi-Scale GraphConvolutional network fitted to our data. Results are promising since several signs are recognized with a high level of accuracy, and an average accuracy of 71% on the top 5 predicted classes from a total of 105 available. An interactive interface with experimental results is also presented. The data and software are made available to the research community.