Research

I'm interested in a wide variety of subjects, including mixed reality environments, computer graphics algorithms, wearable computing, ubiquitous computing and computer science education. My latest research is in Augmented Reality; however, because Clayton State is a teaching university my early work revolved around CS/IT education. If you're looking for something more formal, here's my Statement of Research.

Examples of AR/VR environments

Many people have working knowledge of Virtual Reality - either from what they've seen in horrible movies such as Hackers or from first-person video games. Augmented Reality (AR) is a relatively new area of research that is closely related to VR and uses much of the same technology to support it (including parts of the renderer, tracking devices and interaction techniques). Whereas VR attempts to synthesize most, if not all, of the user's experience, AR attempts to embed virtual objects into the existing, physical environment in real time. It has significantly stricter tracking requirements, as the virtual and physical world must be aligned, and it presents us with new application possibilities and interaction challenges. To help better understand the fields of AR and VR, I have posted (below) a few short clips and descriptions of some of the environments/techniques I have developed.

  This video (~17MB) shows a virtual environment for molecular modeling which was governed by a pre-existing (but modified for collaborative interaction) molecular mechanics server (AMMP). In the image on the left, there is a small molecule (SNG) that was loaded from the command line. At the time, we were able to load molecules of around 15K atoms while still running at interactive rates (because of instancing on the graphics card). Multiple users could simultaneously interact within the environment using a P5 data glove (seen in the video as the infrared tracking panel) which allowed for the natural hand gestures of pinching and grabbing. The environment also supported real-time fragment shaders.
  This is a clip (~9 MB) from an early AR prototype of the molecular modeling environment. The goal was to allow biologists and chemists to visualize and manipulate large molecular structures in a more natural way than VR - such as a conference room. The environment is connected to the molecular mechanics environment as well, but interaction with the molecule did not occur. This video was shot at Georgia Tech around 3AM - when no one else was using the tracker!
  To better understand how users collaborate within these environments, we ran an exploratory user study that specifically studied referencing between pairs, and showed them this training video (~28M) before each trial. Each group was assigned either as a guide or builder. The guide could see an existing physical model, and the builder had to construct it under a variety of conditions. Users interacted with the environment using the P5 data glove again, but the infrared tracker was replaced with a visual tracker (the ARToolkit). To save time, the system was built using DART.
  From our first user study, we found that many guides had difficulty referring to objects - most likely due to the lack of depth cues (such as stereoscopy and shadows). This is a training video clip (~11MB) from a follow-up study that independently investigated factors that influence the ability to give and receive references using a virtual arrow.
  During their December 2000 tour, I toured with Duran Duran as part of the crew (we have the jackets to prove it). Jarrell Pair directed the project while Jeff Wilson, Maribeth Gandy and myself developed the underlying technology that allowed virtual characters to appear "on stage" with Simon Le Bon. We also developed several interesting video filters...
  To better reference embedded objects, here's a multi-modal skew technique for referencing (~8MB).

 

Recent AR in the News

List of Publications

Discipline-related Publications 

Education-related Publications

 

Copies of my PhD Qualifiers (Comprehensives): Theory of Computation, Algorithms, and Architecture