Embodied Multi-Agent VR System
A real-time Unity/C# and Python/FastAPI platform connecting speech recognition, LLM orchestration, speech synthesis, and generated humanoid motion through WebSockets for embodied multi-agent interaction.
Projects
I build VR systems to study human–agent interaction, clinical training, security, and social behavior. These project pages explain the system design, my contributions, and how each prototype was evaluated.
A real-time Unity/C# and Python/FastAPI platform connecting speech recognition, LLM orchestration, speech synthesis, and generated humanoid motion through WebSockets for embodied multi-agent interaction.
Built with two orthopedic experts, this Unity training prototype combines instrument and anatomy interaction with contextual guidance and video pauses at eight critical learning points. Six surgeons evaluated the prototype.
Two interactive Unity scenarios for chest pain treatment and oxygen therapy, developed with nursing educators and iteratively evaluated with experts and student learners.
An Unreal Engine 3D compass for VR password entry that combines symbolic input with contextual cues; a 32-participant study compared efficiency, recall, memorability, and observation resistance.
A multi-user Quest application built with psychologists to study group interaction in VR and video conferencing, with synchronized voice and animation and a desktop host-control app.
A Unity and Photon PUN 2 multi-user grocery-store experience that visualizes interpersonal safe zones and gives post-task proximity feedback; the published system supports up to 20 concurrent live users.