Wonderland–CVE Bridge

I have received a number of guest blog posts from students in Japan and China. This article is the first in a series describing some interesting work being done at the University of Aizu in Japan.

Wonderland-CVE Bridge

By Rasika Ranaweera, Doctoral student, University of Aizu, Japan

The Wonderland–CVE Bridge allows any device that can connect to our CVE server to communicate with Wonderland regardless of any architectural differences. The Wonderland client consists of Avatar System, which is responsible for controlling avatars, including gestures. We used the Avatar client plug-in which initializes avatars to initialize the Wonderland–CVE Bridge.

CVE Bridge image

Bridge in action with NTT DoCoMo iappli i·Con mobile interface

What is CVE?

The CVE is a Java client-server protocol developed by the Spatial Media Group of the University of Aizu. Clients connect to a session server host via channels and when clients need to communicate with each other they subscribe to the same channel. The CVE server captures updates from session clients and multicasts (actually replicated unicast) to other clients via relevant channels. An extensibility “extra parameter” can also be used to exchange information other than position details. This architecture allows multi-modal displays to collaborate with each other, including mobile applications, motion platforms, map interfaces, spatial sound, and stereographic displays.

CVE System Schematic

CVE Bridge System Schematic

CVE Clients

Mobile Interfaces

We have tested the bridge communication with mobile phone interfaces programmed with J2ME on the NTT DoCoMo iappli mobile phone platform. For instance, “Musaic” controls narrowcasting in virtual concerts including local spatialization, µVR4U2C features panoramic images and intensity modulated music, i·Con controls narrowcasting in virtual chat spaces, and i·Con-s models a chromastereoptic spiral spring for such panoramic interfaces.

Rotary Motion Platform

We imported a roller coaster model to Wonderland world and let the avatar walk on the path. Then with some modifications we recorded the avatar location periodically and saved to an xml file. With another application called “Script Interpreter,” the location events can be streamed to the CVE server and trigger the motion platform, so that a user-delegated avatar can ride the roller coaster while the real user can feel proprioceptive sensation through the motion platform.

Multiplicity

“Multiplicity” is a workstation-based narrowcasting interface. An arbitrary number of avatars can be instantiated and dynamically associated with respective users at runtime. Attributes of narrowcasting privacy functions extend figurative avatars to denote the invoked filters. Multiplicity features “mute”, “deafen”, “select”, and “attend” functions, which allow controlling the avatar in a shared conference space. The bridge can now synchronize Wonderland avatars, but in the future we intend to implement narrowcasting functions to Wonderland avatar system.

Map Interfaces

Map interfaces such as “PriMap” & “2.5D Map” display the location of sources controlled by different channels and also allow users to select and move the sources and sinks. Regardless of source and sinks, we can control the avatars and get their location updated and displayed on the maps.

About the Team

  • Rasika Ranaweera – Doctoral student of University of Aizu, Japan, whose research interests include multi-modal interfaces, immersive virtual environments, and spatial sound.
  • Senaka Amarakeerthi - Doctoral student of University of Aizu, Japan, whose research interests include emotion recognition and emotion expression using virtual environments.
  • Prof. Michael Cohen – Professor in the Dept. of Computer and Information Systems, University of Aizu, and Director of Spatial Media Group.
  • Prof. Michael Frishkopf – Assoc. Prof. in the Dept. of Music, Associate Director of the Canadian Centre for Ethnomusicology, and Associate Director for Multimedia at FolkwaysAlive!
  • Dr. Nick Nagel - Senior fellow, architect, researcher and developer for the Media Grid Institute and lecturer at the Boston College of Advancing Studies

For More Information

For more information about this project, please refer to the foll0wing publication:

Rasika Ranaweera, Nick Nagel, and Michael Cohen. Wonderland–CVE bridge. In 12th Int. Conf. on Humans and Computers, Dec. 2009, Hamamatsu.

About these ads

One Response to Wonderland–CVE Bridge

  1. [...] Spatial Media Group at the University of Aizu brought to us by the same team responsible for the Wonderland-CVE Bridge described in a previous Wonderblog [...]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 56 other followers

%d bloggers like this: