iCanLearnNTalk: AI-powered personalized Cantonese learning and 1-to-N immersive oral training integrated systems
For many non-local students and professionals arriving in the vibrant heart of Hong Kong, the melodic but intricate tones of Cantonese often pose a formidable barrier to true integration. Traditional language lab settings frequently lack the spontaneity of real-world interaction, leaving learners hesitant to speak and struggling to bridge the gap between textbook vocabulary and the fast-paced dialogues of the Greater Bay Area. This linguistic disconnect does more than hinder daily errands; it limits academic collaboration, slows professional networking, and prevents newcomers from feeling a genuine sense of belonging within the local community.
Led by Dr Ken CHENG Siu-kei, Principal Lecturer of Chinese Language Centre, the iCanLearnNTalk cluster project emerges as a digital bridge, reimagining language acquisition through an immersive "learn-and-train" ecosystem. At its core, the iCanLearn (P.I.: Dr Sabrina YANG Jianfen) platform serves as a personal AI tutor tailored specifically for Putonghua speakers worldwide. By offering instant, AI-driven feedback on pronunciation and grammar, it transforms the daunting task of mastering Cantonese language into a structured, self-paced journey. This is seamlessly complemented by CanNTalk (P.I.: Dr Ken CHENG Siu-kei), a pioneering oral training environment where learners engage with multiple AI avatars. These avatars boast distinct personalities and communication styles, simulating the unpredictable energy of a group discussion or a high-stakes workplace meeting. This safe yet realistic virtual space allows users to shed their inhibitions, building the confidence and fluency required to thrive in authentic social settings.
Beyond the individual learner, the project empowers educators with deep, data-driven insights into student progress, enabling a level of pedagogical precision previously unattainable in large-scale language instruction. Its versatile architecture ensures that its benefits extend far beyond the lecture theatre, offering corporate sectors and the wider public a robust tool for cultural and professional alignment.
By merging cutting-edge speech recognition with empathetic digital design, iCanLearnNTalk stands as a cornerstone of PolyU Education 4.0. It epitomises an AI-empowered, student-centred model that prioritises experiential learning and inclusivity. This project does more than teach a language; it fosters connection and mastery in a digital age.
This project is awarded under the Teaching Development Grant 2025–28 in the Theme-based Projects category (Cluster Project).