Hobby Projects‎ > ‎

Thesis Work



Creating New Visualization and Human Interface Devices for Therapeutic Video Games
Committee: R. Foulds, PhD, S. Adamovich, PhD, L. Simone, PhD

Abstract

Virtual reality (VR) gaming environment as a tool for rehabilitation of patients with upper extremity disorders is fast gaining momentum. VR based motor training systems provide an engaging, motivating and adaptable environment where the motion of the limb displayed in the virtual world is a replication of the motion produced in the real world by the patient’s extremity. 

The goal of this thesis was to create a generic gaming system which can be interfaced to a number of different Human interface devices (HID) and produce rich graphics to create a virtual environment which closely resembles the real world. This would overcome the current limitations of the ‘HANDS UP’ game developed by the Neuromuscular lab which accepts only a web camera input and uses color marker detection to recreate the limb movements in simple two dimensional environment. 

Three dimensional worlds designed in Virtual Reality Modeling Language (VRML) were controlled using SIMROBOT and Virtual reality toolbox in MATLAB to create better visualization. The Human Interface devices currently used for Virtual Reality video games are expensive and cannot be used for home use. Various new HID’s like the Flock of Birds® from Ascension, Nintendo Wiimote and IMU 6 DOF V3 were tested for their use in the virtual gaming environment. Each device presented their own set of advantages and problems. The thesis work involved understanding and resolving these problems and interfacing the devices with the gaming system.


Key points:

  • Modified SIMROBOT toolbox in MATLAB to control VRML worlds for 3-D game visualization
  • The new toolbox has an ability to accept 6 DOF input
  • Wrote a dll file which calls a C function in MATLAB to access the accelerometer values of the Wiimote

Wiimote with MATLAB



Description:

The Wiimote is first connected to the PC using Bluesoleil software. The Matlab plot shows the realtime change in the values of the accelerometer.


I also worked with interfacing the flock of birds with the gaming system


Flock of Birds interfaced with the game



Description:

Initialially a scaling factor is given as an input to the game. The system converts the translation of the Flock of Bird®(FOB) in space with corresponding tranaslation in the game. The aim of the game is to move the ball (blue) into the basket (brown). The small window on the right shows the existing gaming system with two dimensional graphics. Thus we can see that the new gaming system gives the same representation as the previous version but with better graphics. Also the game can now accept input from a wide variety of Human interface devices.

If you interested I am attaching my thesis documentation here.





Ċ
Kunal Doshi,
Oct 21, 2009, 6:40 PM
Ċ
Kunal Doshi,
Oct 21, 2009, 6:41 PM
Ċ
Kunal Doshi,
Oct 21, 2009, 6:41 PM
Comments