School of Participant(s)

Diocesan Girls' School

Innovative Idea

SignMaster is a mobile app that teaches Hong Kong Sign Language (HKSL). It fills a crucial gap in the market as there are currently no existing apps for learning HKSL. Users can watch video tutorials with clear sign demonstrations across six categories. After that, users can take video-based assessments. An AI model, trained on our 1800-video dataset, provides real-time feedback on users' signing actions. This personalized feedback helps users improve their signing skills. Users can track their progress, identifying mastered words and areas that need improvement. They can also complete interactive multiple-choice quizzes, matching textual descriptions of signing actions with the corresponding words. The app incorporates a virtual rewards system. Users earn virtual coins based on their performance, which they can use to purchase furniture items for their virtual home. Overall, SignMaster is the first app dedicated to teaching HKSL, providing an interactive learning experience for the Hong Kong community.