Visual and Tactile Rendering of

Japanese Traditional Drawings and Costumes

Ukiyo-e is one famous traditional woodblock type Japanese drawing. In ancient age, people put Ukiyo-e on hand and enjoy the sight of beautiful appearance. And, Noh is a Japanese ancient play lasted for 600 years and Noh costumes are precious cultural heritage and made of specially woven silk fabrics. This type cultural heritage is thin with beautiful appearance and can not be touched as its value. A VR system is proposed to permit users watch this type heritage and touch it. This project includes two different researches: appearance rendering and cutaneous tactile sensation rendering. For appearance rendering, a lot of images are taken by camera according to the lighting direction variation. Then, the anisotropy reflection model can be construed from this measured data. As all the parameters are stored as texture, the rendering can run on real-time based on GPU. For cutaneous tactile sensation rendering, when the finger touch and move on the object surface, the finger deformation is simulated based on measured surface meso-structure. Then, compare simulate result to the measured surface strain variation, the relationship between surface meso-structure on surface and tactile sensation can be understood. Based on this, vibration signal is synthesized to present tactile sensation. After all the goal is achieved, user can watch appearance of tangible cultural heritage and touch them. This is one type of next generation digital museum.

Links

CV Lab in Ritsumeikan University(in Japanese)
Robot Lab in Ritsumeikan University(in English)
Haptic research in Nara Women's University(in Japanese)

Related researchs in CV Lab

CG research for rendering the apearance of Ukiyo-e and Noh Costumes.These researches capture reflection feature, then render appearance of object based on proposed model.
download movie1
download movie2
Tactile represent system for Noh mask. The system is consisted of 3D visual display, force feedback device (PHANTom Desktop) and vibration tactile device.
download movie