2025 STEM Summer Internship
MSc in Innovative Multimedia Entertainment
Job Summary
MSc in Innovative Multimedia & Entertainment (MScIME) of School of Design is a taught postgraduate programme working closely with PolyU Research Centre for Cultural and Art Technology and PolyU-NVIDIA Joint Research Centre. As an eligible employer under STEM Internship Scheme set up by the Innovation and Technology Commission (“ITC”), HKSAR government, MScIME is seeking highly skilled undergraduate & postgraduate students in the area of creative technologies, cultural heritage, artificial intelligence generated content, metaverse and digital content to join our team during summer of 2025. We are looking for internship positions under two tracks.
Track 1
Project: Research Laboratory for Advanced Social Robotics(Earnest Design) (4 Positions)
Lab Description:
The Research Laboratory for Advanced Social Robotics is a newly established lab aiming for the Development, Deployment, and Evaluation of Advanced AI Tools (LLMs, Generative Imagery, Avatar Technologies) for Emotional Support and Well-being through Social Robotics in Hong Kong.
Join our cutting-edge research lab at the intersection of Artificial Intelligence, Human-Computer Interaction (HCI), and Human-Robot Interaction (HRI). We just started out in a five-year project for creating and deploying innovative AI-driven solutions—including Large Language Models (LLMs), generative imagery, and avatar technologies—to enhance emotional well-being and alleviate symptoms of anxiety and depression within social robotics contexts in Hong Kong.
Roles:
We are seeking interns to contribute to the research, design, development, evaluation, and field deployment of these AI-powered solutions. We have opportunities available for the following specialized roles:
- Software Engineering Intern
- HCI Intern
- LLMOps Intern
- Avatar and Live Systems Intern
- Experimental Analysis Intern
Qualifications & Skills:
We are looking for motivated individuals with a strong interest in AI, HCI/HRI, and mental well-being. Ideal candidates will possess at least ONE of:
- Strong programming experience (e.g., Python, C++).
- Experience with LLMs, generative AI, or avatar creation tools (including Audio2Face) relevant to your desired track.
- Experience with audio live streaming technologies is a plus.
- Familiarity with 3D modeling is a plus.
- A background in design psychology is highly desirable.
- Strong analytical and problem-solving skills.
- Cantonese speaking ability is a significant plus
Detailed Job Description: Download here
Application form: https://forms.gle/EsD3rD3Uy8Si5zYs5
Inquiry: sd.earnest.lab@polyu.edu.hk
Track 2
Project 1: San Tung UK Virtual Museum Developer
Project Description:
(Direction 1)* - Digital Reconstruction and VR Implementation of Museum: Based on established reconstruction workflows, this project encompasses the museum's digital rebuilding, VR environment deployment, and interactive feature development, requiring competency in Unreal Engine and Quest 2/3 hardware.(Direction 2)* – GenAI-Powered Interactive Guide System for Virtual Museum: Following existing frameworks to implement AI-driven tour interactions in virtual museum, requiring expertise in Quest 2/3 hardware, Unreal Engine, and GenAI development. *You can choose either one direction.
Core Responsibilities:
- Assist in developing immersive VR features specifically Meta Quest headset in Unity/UE.
- Collaborate with the team on the design, implementation, and refinement of augmenting VR spaces.
- Work with AI tools to enhance the realism and interactivity of virtual objects.
- Conduct tests on the Meta Quest to ensure functionality, performance, and user satisfaction.
- Attend and contribute to project meetings, providing updates and receiving feedback on development progress.
Required Skills:
- Experience with Unity/UE is required.
- Basic understanding of VR development, particularly for the Meta Quest platform or other VR development tools is highly beneficial.
- Strong problem-solving skills and a passion for VR technology.
- Effective communication and ability to work collaboratively in a fast-paced environment.
What do we look for in your CV/Portfolio?
- Prior experience of applications built for Unity/UE and combination with AI tools.
Project 2: GenAI-empowered Design Activities Research Intern
Project Description:
Conduct research on GenAI-based multi-agent systems and their applications in enhancing teamwork and creativity in the design process.
Core Responsibilities:
- Develop and test prototypes of multi-agent systems, including front-end development and interface design, to evaluate their effectiveness in collaborative design tasks.
- Collaborate with cross-functional teams to integrate GenAI-based solutions into existing design workflows.
- Utilize Python for data analysis, system development, and automation tasks related to the project.
Required Skills:
- Experience with Unity is required.
- Experience with Python is required.
- Interest in GenAI technologies and their application in design.
What do we look for in your CV/Portfolio?
Technical skills and track of records.
Project 3: Digital Human motion in VR
Project Description:
We are creating a digital human for exhibition and academic research. We are looking for a developer with experience in the development of the digital human animation and build this project in VR environment. The project already has a mature digital human model, a large language model driven backend, and skeleton redirection files. As a student helper, you will participate in the creation of character animations and VR development in digital projects using Metahuman skeletons.Core Responsibilities:
You start your work based on the basic information of this project and the basic model. Your responsibility is to create a character motion animation based on this. If interested, you can also participate in the subsequent user experiment and writing of academic papers.
Required Skills:
- Have a good sense of artistic aesthetics.
- Possess UE Blueprint development experience and understand the motion state machine in UE.
- Be able to handle the Metahuman skeleton system and perform animation redirection in UE. Or have experience in processing infrared motion - capture data or action redirection. Be able to use standard skeletons (BIP/Unreal Standard Skeleton) for binding.
- Better VR development.
What do we look for in your CV/Portfolio?
- Animations and prior work that illustrates your capacity.
Project 4: XR and LLM Empower Game NPC
Project Description:
As an intern, you will be actively involved in developing an intelligent NPC in an XR (Extended Reality) game. The core of this project is to integrate Large Language Models (LLMs) to enable the customization of NPC dialogue styles and personalities, thereby creating a more immersive and interactive gaming experience.Core Responsibilities:
- Assist in developing NPC behaviors and interaction logic within the XR environment.
- Research and participate in integrating Large Language Models (LLMs) for generating and customizing NPC dialogue.
- Design and implement different NPC personalities and dialogue styles.
- Conduct testing and iteration in the XR environment to ensure the intelligence and stability of the NPCs.
- Collaborate with team members to jointly advance the project.
- Attend project meetings, share development progress, and receive feedback.
Required Skills:
- Basic knowledge of XR development (experience with Unity or Unreal Engine preferred).
- Basic understanding of or strong interest in Large Language Models (LLMs) or related AI technologies.
- Excellent problem-solving skills and a passion for cutting-edge technologies (XR/AI).
- Good communication skills and ability to work collaboratively in a team.
What do we look for in your CV/Portfolio?
- Relevant XR development project experience (personal or team projects).
- Experience participating in AI, LLM, or Natural Language Processing related projects.
- Game development experience.
- Projects that demonstrate your ability to solve complex technical problems and your innovative thinking.
Project 5: Design and Testing of VR Rhythm Games for Cognitive Training
Project Description:
You will participate in an innovative project that integrates existing VR rhythm games (e.g., Beat Saber) with classic cognitive training paradigms to design a VR rhythm game aimed at cognitive function training. The system will be evaluated using both objective and subjective measurement methods. The focus is on implementing VR game functions using Unity and participating in validation experiments to assess the game's effectiveness. In this project, you will gain experience in VR game development, learn about cognitive function training methods, acquire user research skills, understand interdisciplinary human-computer interaction (HCI) design, collect physiological data (e.g., EEG), and have the opportunity to contribute to top-tier conference and journal publications.Core Responsibilities:
- Collaborate with the team to develop and refine rhythm game functionalities using Unity.
- Collaborate with the team to participate in user research and validate the effectiveness of the game.
Required Skills:
- Experience with Unity is required.
- Basic understanding of VR development, particularly for the Meta Quest platform or other VR development tools, is highly beneficial.
- Strong problem-solving skills and a passion for VR technology.
- Effective communication and ability to work collaboratively in a fast-paced environment.
- Responsible, and patient when organizing in user studies.
What do we look for in your CV/Portfolio?
- Prior experience in applications built for Unity; or
- Experience in user study.
Project 6: VR Developer – AI-Assisted VR Content Generation and Optimization
Project Description:
In this project, you will actively participate in the development of virtual reality (VR) applications on the Meta Quest platform. You will also leverage OpenAI technologies and other leading large language models (LLMs) to develop and refine reasoning capabilities for VR content creation.Core Responsibilities:
- Collaborate with the team to develop VR applications using Unity.
- Work with the team to build reasoning agents using OpenAI and other LLM platforms.
Required Skills:
- Experience with Unity is required.
- Python experience is required.
- Ability to work with APIs and integrate various software components.
- Interest in AI technologies and their applications in virtual reality.
- Strong problem-solving skills and a passion for VR technology.
What do we look for in your CV/Portfolio?
- Experience developing applications in Unity; or
- Experience developing with API-based OpenAI tools and other leading large language models.
Project 7: VR Interaction Experience with 4D Gaussian Avatars
Project Description:
In this project, you will actively participate in the development of virtual reality (VR) applications on the Meta Quest platform, leveraging 4D Gaussian avatars to design interactive experiences and enhance user engagement.Core Responsibilities:
- Collaborate with the team to develop applications involving 4D Gaussian avatar interactions using Unity or Unreal Engine (UE).
- Work with the team to conduct related user research.
Required Skills:
- Experience with Unity and/or Unreal Engine (UE) is required.
- Interest in AI technologies and their applications in virtual reality.
- Strong problem-solving skills and a passion for VR technology.
What do we look for in your CV/Portfolio?
- Experience developing applications in Unity or Unreal Engine.
Application
-
Go to the following Application form to submit your CV and related materials for the application.
-
Application will be closed on 11 Jun 2025.
Eligibility for STEM Internship
As required by ITC, the STEM Internship Scheme is open to undergraduates and postgraduates who are:
-
local or non-local students enrolling on one of the full-time STEM programmes (please refer to the “List of Eligible STEM Programmes” on this page) recognised by ITC to be eligible for the Scheme; 【Due to an exhausted budget, we can only make offers to local students for this STEM Summer Internship 2025.】
-
from any year of studies; and
-
legally employable in Hong Kong.
Interested candidate should note that this internship CANNOT be used to fulfil WIE requirements. For more details, please refer to Notes for Students.
STEM Internship Job Offer
The internship will be offered for 2 months within the period from early Jul 2025 to late Aug 2025, subject to Project Leader. Successful candidate will receive allowance for HK$11,490 per month (i.e. 30days).
Inquiry
Email: nvidiarc@polyu.edu.hk
Tel: 2766 4710 (Miss Wong)