Key Capabilities

What HAI could do in the classroom
Six capability clusters powering a 6-scene multimodal educational arc
👋
CAP 01

Welcome & Orientation

HAI opened each session with a choreographed entrance — Star Wars BGM, synchronized screen visuals — greeting students by school name and setting the program agenda. This established HAI as a co-facilitator, not a prop.

TTS Narration Screen Sync Character Design
💡
CAP 02

Future Finance Storytelling

Delivered scripted explainers on robo-advisors, digital currency, and portfolio management — abstract concepts translated into approachable narratives with display screen visuals running in parallel.

Fintech Explainer Display UI Dual-Channel Output
🎙️
CAP 03

STT Conversational AI

Students could speak directly to HAI — voice was captured via STT and parsed for financial concept queries (e.g., portfolio). HAI responded with AI-generated explanations in real time.

Speech-to-Text NLP Response Live Dialogue
🤝
CAP 04

Hand-Sensor Physical Interaction

Students physically walked up and held HAI's hands to select quiz answers — left or right hand mapped to two options. A "charging energy" performance turned an abstract sensor into a memorable bodily experience.

Hand Sensor Haptic Metaphor Physical UX
🎮
CAP 05

Financial Bingo Game Host

HAI hosted a 9-square bingo game covering financial literacy topics. Four main topics + bonus squares. The game was split into 4 resumable sub-scenarios for field reliability — preventing full restarts on failures.

Game Design 9-Square Bingo 4 Sub-Scenarios
📺
CAP 06

Synchronized Display UI

Every HAI speech act was mirrored on a wall-mounted screen — quiz questions, bingo boards, program schedules, and video content. Both channels (audio + visual) were scripted and timed together.

Screen UI/UX Audio-Visual Sync Content Design