Get the Flash Player to see this video.

The virtual anatomical assistant

An innovative installation developed by Dr. Klaus Dorfmüller-Ulhaas and his team

“Ritchie“ hides behind the virtual anatomical assistant, a computer based character, who shows in a digital mirror. The physical world in front of this mirror will be received with the aid of a camera and completed by virtual objects, which show in the digital mirror. The virtual assistant seems to be seamlessly combined with reality and even acts intelligently on the visitor’s behaviour. The virtual character was programmed with real-time rendering via the graphics 3D-engine “Horde 3D“ (an open source project by Nicholas Schulz). Behind Ritchie’s intelligent behaviour stands the context-sensitive authoringsystem ACOSAS, developed by Dennis Erdmann and Volker Wiendl. ACOSAS tells stories in consideration of external influences.

A real skeleton in front of the digital mirror provides the visitor’s curiosity. In case a person approaches the exhibit, the virtual assistant welcomes the visitor and invites him to supplement the skeleton by virtual organs. The recognition of individuals results by a separate camera with special software (Computer Vision). A display of potential human organs is now visualised in the digital mirror. With a sort of 3D-mouse the visitor selects an organ and places it as exact as possible on the skeleton. The virtual anatomical assistant comments the actual configuration and assists with knowledge of the human body’s anatomical composition. The extension of reality (Augmented Reality) by virtual objects happens by the digital mirror. In addition to the camera, which receives the physical world, the stereoscopic infra-red tracking system (developed by “Inoptech“ GmbH) gathers the 3D-mouse movements as well as the skeleton’s marked points.

The tracking system uses multiple intelligent cameras, which operate the image processing already in the camera’s hardware. The results of the segmentation will be combined on a central PC in a self-developed PCI plug-in card and transfered via former 3D-calibration information. The globular, coated markers will be identified because of their retroreflective foil. Different globes will be arranged in a way, that they describe a solid body, and allow  the determination of the position and orientation with 6 degrees of freedom. The cameras are characterised by the smaller size (compared to competitors) and therefore easier incorporation in VR installations than e.g. a CA VE, without taking much of the projection screen. The whole system is very userfriendly and can be calibrated directly at the customer without deeper knowledge. Moreover, the complete hardware (except optic and sensoric) could be developed, therefore the camareas can be produced at a bargain price.

• The virtual assistant reacts intelligently to the users behaviour. Actual game applications and film productions operate with a static script.

• The user stays in his environment. The virtual character and more virtual objects are embedded in a real environment and enlarge the physical world.

• Natural, intuititive human computer interface: A haptic interface provides a greater extent of reality.

Augmented Reality applications with intelligent virtual characters could be perfectly established in teaching (schools, unversities) and for the documentation of operational procedures (e.g. attendance and assembling). Derivatives of this application could be established in shopping malls for virtual fitting or as hairdresser’s style counseling.