Research

We propose a method for generating and placing rocks of various sizes. Previous methods did not control sizes of rocks. To improve the modeling, our method generates rocks by a graph synthesizing some Voronoi diagrams. Each Voronoi diagram is constructed using a set of isotropic sites calculated from Poisson-disk distribution. Each diagram contains uniform-size cells, and the diagram can specify the size of its cells. To construct a graph from these diagrams, a synthesis exclusively selects some cells from each Voronoi diagram, in descending order of size. A triangulation generates a mesh with additional vertices in each cell of the synthesized graph, and then rock shapes are formed by swelling the mesh in three-dimension to form various rock shapes. This procedure alters the sizes of rocks, and can generate more realistic scenes.

In this project, we focus on the generation of pebble mosaics to achieve the distribution of numerous pebbles while maintaining distribution controllability. Existing research on rock modeling and digital mosaics has not focused on user-specified arrangements, whereas in this work, we present an interactive method for generating pebble mosaics. This is achieved through designing an underlying tensor field that specifies the pat- tern of pebble arrangement. The experimental results show that a realistic visual quality is obtained using our proposed method.

This project proposes a combination approach of rule-based modeling and procedural modeling to create books and bookshelves for various scenes. Using our approach, we can give the generated model more broad variations, with parameterized variables by employing the procedural method, and with weighted rules by employing the rule-based method. In addition, rules composed with hierarchical considerations give the modeling approach more broad variations. Furthermore, considering repetitive patterns of layout of bookshelves occurring in scenes such as libraries and bookstores, we can easily change the details. This saves costs to produce a scene similar to but slightly different from the original scene.

A processing plant consists of massive parts including tanks, pipelines, processing columns, frames, and so on. This paper reports a method for automatically generating the landscape of a processing plant from a 2D sketch input and some control parameters. This is difficult to implement with conventional procedural methods. The results show that the landscapes of a processing plant are satisfactorily represented, while some detailed parts, such as valves, steps, and branching pipelines, are not generated. The generated 3D geometric data are useful for constructing background scenes in movies and video games, and are also applicable for pre-visualizing a landscape to construct a processing plant.

This research enables a CG designer to create forests with multi layered structures, which are specified by image data. A user can design a forest vegetation interactively by means of editing 2D image. And then, 3D forest models are generated after the vegetation simulation.

This project proposes a support tool for designing kimono patterns. Kimono patterns are controlled by two rules, "flow" and "hierarchy"; the rule of "flow" controls the pattern arrangement, and the rule of "layered structure" manages the layer structure of pattern. The proposed system supports design of kimono patterns, considering these two rules.　The system also applies L-System to express ornamental patterns of plants to appear in kimonos semi-automatically. It is possible for people who do not have good design skills to obtain an intended kimono pattern easily by using this system.

This method generates a mosaic image from 3D models. This approach has two advantages; 1) It is possible to render a mosaic image from multiple viewpoints. 2) The resulting image represents three-dimensional features, such as surface ridges and wrinkles, accurately. These features are sometimes not depicted in 2D images, and it is hard to extract them from the source image.

This project proposes a method to render a comic-like image from 3D model. The system extact the edges from specified 3D models, and then these edges are coverted into comic-like pen strokes.

This project proposes an algorithm which can produce various styles of painting from source photos. Algorithmic Painter is created by enhancing Synergistic Image Creator, is a painterly rendering method, to be highly expressive but to still reserve the essential characteristics of the source photo. To achieve this, our method extracts three types of image segments automatically from a source photo by newly proposed classification method: edge areas, homogeneous areas, and highly contrastive areas. Next, each obtained image segment is converted into a brushstroke. Finally, the target picture is rendered by assigning a color to each pixel. Furthermore, this method can control the curvy shapes of brushstrokes, so that the obtained image can not only incorporate various artistic touches but also natural touches.

(Joint project w/ Prof.Kasao @ Tokyo Polytech Univ.)

This project presents a hairstyle simulation system that automatically fits a stored hairstyle image to a captured face image. The target hairstyle image is adjusted in accordance with face feature data, and is then transformed by an image warping operation to fit the face image.

This research proposes a framework that generates free fall motions for the object within a still fluid. We introduce a new motion synthesis approach where six characteristic motion prototypes of free fall are defined and synthesized, and then the motion trajectory is specified form free fall motion graph. We automatically create motion sequences using trajectory search tree and pre-computed trajectory database. The proposed approach can produce realistic and controllable free fall motion that could be applied in many different applications, including virtual reality, game and other entertainment productions.

Our method provides a simple and effective font selection process based on the users' KANSEI. In several experimental evaluation, we affirm that our method is effective in searching for a desired font, helping users obtain a font suitable for an alphabetic character and non-alphabetic character. The aim of this study is to develop a method to help users find a suitable font without displaying all the choices.

The aim of this study is to investigate people's perception on gender of 3D shape in terms of semantic association such as "feminine" or "masculine". Three elements of 3D shape were considered to investigate its gender, first is variable base, second is variable sweep, and third is variable axis. In this paper we observed the eRect of variable base on perceiving gender kansei of 3D shapes as an extension of our earlier work. To assess base-variance of 3D shape, we examined whether convexity and concavity of base in the context of sharp and curved forms. Results of our psychophysical experiments will be very important and helpful in the kansei-driven design.

This application motivates a user to crush an empty can based on fun theory. The system measures a strength of pressing an empty can, and the measured data are used to launch a rocket. The launched rokect sow seed in the soil, and the flowers blossom. The color of flower is related to the color of cruched can. The user enjoys crushing cans playing the game.

This system allows a user to make a paper from clouds. A user scoops up clouds which is exhausted from a smoke generator with a pad. The image of scooped clouds on the pad is captured by a CCD camera, and then the user shakes the pad to control the pattern of smoke. Finally, the pattern of smoke is converted to the fibers of an intended paper.

This application allows someone to experience to use the superpower. We focused attention on Spiderman as one of the famous super heroes. In this application, the user can jump from one building to another by using a spider web and being stuck to it like Spiderman. The most important thing is the method of the pulling force feedback in this application. Hence, we made a novel pulling force feedback system by means of vaccum device. By this system, the user feels the pulling force. The aim of this application is to give the user the enjoyment of using superpower.

There are a lot of face-like objects and materials in our living　environment. If things look like faces, we can interpret the things as if they were living things. However, such faces are only objects. Therefore, they can’t create facial expressions and speak. If those faces could move and speak, it would be a very amusing discovery and experience for many people, especially children.

This project presents a system that generates landscapes using a cocktail analogy. With this system, users generate landscapes by combining "ingredients." Users select a bottle containing the intended landscape element and pour an appropriate amount of water into a shaker. The amount of water used from each bottle determines the ratio of landscape elements. The relief of the surface and the position of each element are changed by shaking the shaker. This system provides the enjoyment of creating one’s own favorite scenery.

This project presents a novel interactive application that realizes fracture of virtual objects by stirring them with a wand. This application calculates collision force for each object, and an object breaks apart when it collides hard with others. The player crashes the objects interactively with a feeling of haptic sensation, and watches computer-generated imagery of fracture simultaneously.

This project presents an interactive system which controls fountains so that wind generated by a fan blows off spring water.　The system consists of seven fountain units; each unit has a PC-controlled water pump and nine full-color LED lights. The lighting color and expelling speed of water are controlled with motion of player's fan.

This project presents two virtual reality applications that give real baseball experience by means of wireless acceleration sensor and strip screen. These applications have more direct and intuitive input method than traditional baseball video games. Wireless acceleration sensor allows us the same motion as real pitching motion. Strip screen connects the real world where the player and the real ball are and the virtual world where the virtual ball and virtual actors are seamlessly.

Tomte is a body sensory style VR application, which captures the player's hand motion as an input, to control the virtual character, in the theme of "Puppet Play". Tomte can be played in real-time, controlling the virtual character in many ways. The system renders the character animation which is controlled by the player's hand motion captured with the USB camera. This application realized a novel method for character animation that enables to play it intuitively, and also no need to wear any device. Tomte proved the possibility of controlling the computer without a device, and also an application of the gesture recognition.

This project introduces a match-up style VR application in the theme of Paper-craft Sumo using displacement data. The VR system captures the waving motion data, and calculates the movement of the Paper-craft Sumo Wrestlers, which are projected onto the floating screen on water, using those data. The system captures the player’s motion data as displacement values by means of the distance sensors, and the data are used for their interaction model. New body sensory style application is implemented by using intuitive and robust interaction methods.

This paper introduces a digital image editing system that can be operated intuitively. In this system, the target image is projected on a back projection screen, and the user retouches the image using an infrared lighting device. The quantities of light on the screen are captured by means of a CCD camera. Then, the image is edited according to the amount of infrared light. This system makes it possible to process images directly and intuitively. Moreover, this method has the advantage of allowing simultaneous editing by two or more people.

An interactive image viewer, “ViewFrame”, by means of image-based face detector without marker is proposed. In this paper, the concept, “window-though reality”, is introduced. A window in a room is replaced with a LCD or another flat screen, and this system displays a view-depended CGI scenery that would be seen from an observer. This system is required to react to user’s action in real time; therefore the image processing is implemented by means of pixel-shader functions for GPU to accelerate the process. This system makes it possible to recognize the depth of image and three-dimensional shapes easily by natural man-machine interaction.

What will be affected if the scenery seen with a walk is replaced by the act of swimming? This project proposes a method of replacing various vision experiences accompanying such body movement by means of computer. Reference light is reflected with the reflector with which both arms were equipped, and the reflected light is observed with the CCD camera. Next, the motions of arms are analyzed by means of image processing, and then the speed of video is controlled in accordance with change of the motion. The posture of the body of equipment is also controlled in accordance with change of the motion by means of air blowers. Therefore, an audience may feel swimming in the video.