Building AI agents and interactive systems

Wai Hang Wong

Graduate Student in Artificial Intelligence
Tsinghua Shenzhen International Graduate School, Tsinghua University
Artificial Intelligence, Wuhan University · 2022–2026

Portrait of Wai Hang Wong
Academic profile photo for OpenReview and research contact.

I build AI agents and interactive tools across virtual avatars, basketball video analysis and storytelling, personal writing, research workflows, and robotics communities. My current work connects language models with software tools, visual interfaces, and human interaction.

About

Profile & Current Work

I am a graduate student in Artificial Intelligence at Tsinghua Shenzhen International Graduate School, Tsinghua University, following my undergraduate studies in Artificial Intelligence at Wuhan University (2022–2026).

My projects explore how language models can support useful interactive systems: dialogue and animation in OpenAvatar, source-timed basketball video stories in GameTrace, writing and memory tools in DayDream, and reusable research workflows. I also build community interfaces for robotics and campus collaboration.

Current Work

Work & Interests

AI Agent Workflows

Connecting language models with tools, structured outputs, and repeatable workflows, as explored in OpenAvatar, ScamShield, and the ReSearching toolkit.

Embodied Interfaces

Dialogue, expressions, and animation for Unity/VRM avatars in OpenAvatar, alongside robotics community and device-interface prototypes.

Video Analysis & Storytelling

Source-timed basketball video stories in GameTrace, bringing narration, subtitles, visual overlays, and replay together in a reviewable experience.

Human-AI Interaction

Interfaces that let people inspect, edit, and use AI output, including personal writing in DayDream and risk explanations in ScamShield.

Research Tooling & Evaluation

Reusable prompts, Skill modules, and project templates for research tasks, with attention to traceable inputs, task completion, and clearly bounded results.

Projects

Selected Projects

AI systems, useful tools, and communities built around human interaction.

Explore the code, try a deployed app, or follow a prototype. Each project shows its current stage and available entry points.

Hackathon prototype · Team 09

GameTrace · The Second Game Tracer

  • Basketball video
  • AI storytelling
  • AWS

An AWS workbench for turning basketball footage into source-timed commentary and Second Look stories. It connects video evidence, storyboards, voice narration, overlays, rendering, and playback in one workflow.

  • English commentary, subtitles, and slow-motion review
  • Source-linked evidence and editable video stories

Prototype demonstrations; player tracking and tactical interpretation remain under evaluation.

Open-source framework

OpenAvatar

  • Unity
  • VRM
  • LLM interface

A virtual agent interface that maps structured language-model responses to dialogue, avatar expressions, and animation. Built with Unity and VRM, it supports Ollama and custom JSON API providers.

  • Expression and action control through structured responses
  • Configurable local and remote model connections

Open-source hackathon prototype

ScamShield

  • Android
  • Gemma
  • FastAPI

An Android anti-scam prototype that combines local rules, Gemma-based analysis, and web checks to explain risks in user-authorized messages and screen content.

  • Risk explanations and verification prompts
  • Android client with a Python backend

An experimental risk-checking assistant; detection effectiveness is not established.

Open-source workflow toolkit

ReSearching Workflow Toolkit

  • Skills
  • Research tooling
  • Python

Reusable prompt modules and project templates for literature review, critical ideation, experiment planning, figure making, writing, and review. The toolkit helps users carry context across stages of a research workflow.

  • Task routing and reusable Skill modules
  • Project templates and a prompt-generating CLI

Invitation-only beta

DayDream

  • Personal writing
  • AI-assisted stories
  • Web app

A diary and storybook workspace connecting everyday notes, calendar tasks, people cards, and editable chapters. Original facts stay available while users review and shape AI-assisted narratives before adding them to a book.

  • Diary capture, chapter editing, and book reading
  • Account-separated workspaces and backup export

Public MVP

Gathering

  • Campus research
  • Questionnaires
  • Community

A campus research community where researchers publish studies and participants contribute responses. It supports Markdown and TSV questionnaire imports, participation points, and result views.

  • Study publishing, response collection, and withdrawal
  • Results charts and an administrator overview

Deployed community · device prototypes in development

Companion Protocol · 共伴协议

  • Open robotics
  • Wearables
  • Human-agent interaction

A developer community connecting wearables, AI agents, and open robots through project pages, documentation, and discussion. Reachy&Us explores a smart-glasses-to-agent-to-Reachy-Mini interaction loop.

  • Member profiles, discussions, replies, and project documentation
  • Interactive 3D companion and a Reachy&Us project walkthrough

Reachy&Us is a hackathon prototype; the project page includes architecture and preset examples.

Open-source learning template

Campus Interaction Platform

  • JavaWeb
  • MySQL
  • Tomcat

A starter template for campus task collaboration, built with Servlet, JSP, JDBC, MySQL, and Tomcat. It brings together accounts, task publishing, order tracking, comments, messaging, and administration.

  • End-to-end campus collaboration examples
  • A codebase for learning and rapid prototyping
Education

Education

Wuhan University

B.Eng. in Artificial Intelligence

School of Computer Science

2022 - 2026

Tsinghua University

Graduate Student in Artificial Intelligence

Tsinghua Shenzhen International Graduate School

2026 - present