Couger Develops Virtual Human Agent with Sight and Hearing, Also Provides Technology for KDDI's "Virtual Character x xR" Project

Couger Inc. (Location: Shibuya-ku, Tokyo; hereinafter "the Company") has developed a Virtual Human Agent as part of the development of “LUDENS”, a technology that combines AI, IoT, AR/VR, and blockchain to make space smart. We are also pleased to announce that we have provided technical support for the "Virtual Character x xR" project of KDDI Corporation (Location: Chiyoda-ku, Tokyo, hereinafter "KDDI") regarding this technology.

■Next generation interface for smart spaces

Virtual Human Agents are virtual characters with five senses (sight, sound, etc.), emotions, and intelligence. Through machine-learning-based video and voice recognition, they can grasp images and situations in the real world in real time, and then use their unique character AI to react, talk, and operate home appliances, enabling them to think and communicate like human beings.

We have been providing companies such as Honda R&D and universities with "Street," a learning simulator that enables AI and robots to learn how humans behave. Inside the simulator, a 3D virtual character makes decisions based on the situation and acts like a human. The Virtual Human Agent is an advanced version of the character that understands the situation in real time by extending the character's video, audio, and other input processing.

We believe that as IoT devices and self-driving cars become increasingly popular, not only our homes but also our cars and other moving spaces will become smarter. Virtual Human Agent will be the new interface for the "Smart Space" that AI, IoT, AR/VR, and blockchain will work together to realize.

KDDI Provides Technology to KDDI's "Virtual Character x xR" Project

We have provided related technologies for Virtual Human Agent to KDDI's "Virtual Character x xR" project. In this project, virtual characters have vision, hearing, and emotions, and can communicate like humans.

Outline of KDDI's "Virtual Character xR" Project

In addition to the development of the "Miku☆Sanpo" AR application, KDDI has developed a unique AI that enables virtual characters to recognize and understand real-world situations, such as surrounding objects and voices, and to act accordingly. This has enabled more natural communication with the characters.

  • About “LUDENS”

We are developing our proprietary technology "LUDENS", which combines AI, IoT, AR/VR, and blockchain to make space smart.

  • About MikuSanpo

An application that utilizes AR technology. When you launch the application and hold it up to the real world, a life-size "Hatsune Miku" created with a 3D model appears, allowing you to see her from all angles, take a walk with her, and take pictures of her.

An AI learning simulator that enables AI (Artificial Intelligence) to learn any situation by creating 3D models of humans, objects, environments, etc. and simulating their states and behaviors in a virtual space. It is also installed at Honda R&D Co.

Recommended articles