The Mirror of Humanity: How Professor Hiroshi Ishiguro is Building a Symbiotic Avatar Society to Combat Japan’s Demographic Crisis

Humanoid Summit2026

「Humanoids, Interaction, and Real-World Deployment」

Hiroshi Ishiguro, Director at ATR Intelligent Robotics and Communication Laboratories at Osaka University

At the landmark Humanoid Summit Tokyo 2026, Professor Hiroshi Ishiguro—Osaka University Professor and the Director of the ATR Intelligent Robotics and Communication Laboratories—delivered the opening keynote address under the title “Human Avatars and Future Society”. Speaking to a global audience, Ishiguro outlined the 25-year trajectory of his pioneering work in intelligent robotics and presented a transformative vision of a "human-robot symbiotic society".

As staff members prepared a hyper-realistic android copy of the professor on stage, Ishiguro invited the audience into a profound exploration of what it means to be human in an age where the boundary between biological and synthetic existence is rapidly blurring.

The Dual Pillars of Human-Robot Interaction (HRI)

Over his 25-year career pioneering the field of Human-Robot Interaction (HRI) alongside American and European researchers, Professor Ishiguro has focused on two distinct research pathways: fully autonomous robots and human-operated "avatars". In his address, Ishiguro offered a crucial redefinition of the "avatar" to distinguish it from autonomous AI systems:

• An avatar is "a robot or computer graphics (CG) character operated by either an AI or a human operator, specifically designed to reflect human personal and social intentions".

Because avatars are not fully autonomous, they serve as extensions of human agency, operating in strict alignment with the social and personal intent of their operators. According to Ishiguro, this pursuit of robot-led human development has always had two primary societal goals:

• Aesthetic and Functional Enrichment: Designing beautiful and highly functional robots that directly elevate human quality of life.

• Scientific Self-Discovery: Utilizing robots to deeply understand the mechanics of human nature itself.

Because the human brain possesses highly specialized cognitive structures dedicated to recognizing and interacting with others, a realistic android behaves as a "verifiable model (testbed)". By meticulously mimicking human behavior, these machines allow scientists to test and verify the inner workings of human brain activity and cognitive processing, making them powerful tools for self-understanding. This quest for self-understanding is the core reason Professor Ishiguro has spent a quarter-century constructing lifelike humanoid androids.

The Conversational Breakthrough: Large Language Models and Consciousness

For decades, the physical elements of robotics—such as manipulators, tactile sensors, speech recognition, and image comprehension—progressed steadily. However, the most formidable bottleneck remained natural conversation. Historically, dialogue systems were manually built by engineers designing rigid rule-based frameworks, which ultimately faced hard limits in replicating the organic fluidity of genuine human interaction.

The integration of Large Language Models (LLMs) has fundamentally shattered this barrier. By integrating LLMs with humanoid platforms, researchers have unlocked highly natural conversational capabilities. This breakthrough has shifted the academic frontier toward studying high-level human cognitive dimensions, including:

• Embodiment: Exploring the psychological and physical meaning of possessing a physical body.

• Multimodal Integration: Enhancing how robots perceive and express complex information.

• Cognitive Design: Formulating internal intentions and desires within synthetic architectures.

Professor Ishiguro is now leveraging these advanced models to study "consciousness"—the most complex and elusive

frontier of cognitive science. Because human consciousness is deeply rooted in social relationships, Ishiguro asserts that deploying lifelike robots in active, real-world social environments is the most effective way to better understand the mechanisms underlying consciousness.

Mind-Bending Tech: The Android That Learns on Its Own

In a striking live demonstration, Professor Ishiguro interacted directly with his android double on stage. Supported by his laboratory's proprietary technologies and advanced LLMs, the android has ingested nearly all of Ishiguro’s published books and extensive media interviews. Under the professor’s guidance, students meticulously mapped out and implemented his distinct personality traits and communication styles into the robot.

Most remarkably, this android has begun accumulating "its own unique experiences".

• While Professor Ishiguro is physically presenting on stage, his android double can simultaneously interact with individuals in a completely separate location.

• Consequently, the android is actively building a repository of conversational experiences and memories that the real professor has never personally lived.

• The system is equipped with advanced identity-recognition capabilities, allowing the android to identify individual conversation partners and retrieve memories of past interactions linked directly to those specific people.

The Academic Frontier: Implementing the "Self"

The immediate research goal of the Ishiguro Laboratory is the realization of "access-level consciousness"—essentially implementing a coherent sense of "self" within an android. In everyday life, human beings dynamically switch between fragmented personalities depending on their environment, such as at the office, school, or with friends. Access-level consciousness is the neurological glue that integrates these disparate social personas into a single, unified identity. Ishiguro believes that building androids capable of this integration will finally decode how human consciousness operates.

Japan’s Demographic Crisis: A Cultural Opportunity for Symbiosis

The drive toward an avatar-integrated society is not merely academic; it is a structural necessity for the survival of Japan. Demographers project that Japan is on track to lose 30% (approximately one-third) of its entire population over the next 50 years, creating a severe labor shortage and population crisis.

Unlike continental European nations or the United States, which share land borders and can readily absorb foreign labor, Japan’s island geography, unique culture, and steep language barrier make relying on mass immigration highly challenging. However, Japan possesses a powerful, unique cultural asset: a highly positive and receptive attitude toward AI and robotics.

By capitalizing on this cultural openness, Japan can pioneer a "human-robot symbiotic society" that deploys autonomous AI and human-operated avatars to sustain and revitalize its national infrastructure.

The Government’s Moonshot Initiative and Field Successes

This vision is heavily backed by the Japanese government's flagship research initiative, the Moonshot Research and Development Program (administered by the Cabinet Office).

• Goal 1 (The Co-existence Avatar Project): Aiming for full realization by 2050, this project seeks to build a society where anyone—including the elderly, people with physical disabilities, or those with cognitive limitations—can transcend biological constraints. By using robotic and CG avatars to expand physical, cognitive, and sensory capabilities, the project aims to minimize physical commuting, secure valuable disposable time, and revolutionize education, healthcare, and daily labor.

• Goal 3: Focusing heavily on accelerating the physical capabilities of humanoid robots.

Led by a massive coalition of over 40 professors from top-tier Japanese and international universities, the Moonshot Goal 1 project is five years into its ten-year roadmap. The details of this massive undertaking are compiled in the open-access book "The Symbiotic Avatar," and the team has already executed over 100 successful field trials across Japan.

Key Case Studies in Avatar Deployment

1. "AVOC" at Theme Parks: A small, visually charming AI robot avatar named AVOC was deployed in amusement parks. When visitors pose complex, highly specific questions, a professional human operator located remotely can seamlessly intervene through the avatar. This hybrid model offers an elegant solution for hospitality businesses suffering from acute labor shortages without requiring a massive on-site staff.

2. Android Cabinet Ministers: The laboratory constructed a hyper-realistic android modeled after a former Japanese State Minister. High-ranking political travel typically incurs massive financial and logistical costs. By using a realistic android avatar, the minister can instantly "appear" at overseas venues to deliver critical addresses, completely bypassing traditional travel constraints and security risks.

3. The Osaka-Kansai Expo Pavilion: As a key producer for the World Expo, Professor Ishiguro designed a futuristic pavilion exploring a world 50 years in the future where human memories are uploaded to androids. Featuring a central android copy of himself and interactive CG avatars guiding visitors at the entrance, the exhibition was so popular that it required strict entry restrictions due to continuous capacity crowds.

Note: Following the success of the Expo, a massive public exhibition will run from late July to late September 2026 at Mont Takanawa (Museum Takanawa), showcasing 30 mobile robots and 20 highly realistic androids—including monkey-like robots and highly unconventional designs.

AVITA: Empowering Marginalized Communities and Redefining Labor

To bring these innovations to the market, Professor Ishiguro founded and operates AVITA Co., Ltd. (with "AVITA" derived from the Italian word for life, "vita"). Ishiguro notes that the historical failure of commercial robotics lies in the absence of a "killer application". He is convinced that what he considers the "killer application" is the avatar.

AVITA began by deploying highly expressive 3D and animated CG agents on consumer smartphones, tablets, and PCs. This framework has quickly evolved into a powerful engine for social inclusion and employment:

• Inclusive Employment: By operating avatars from home, individuals can access remote service, hospitality, and customer-facing jobs without the physical exhaustion of crowded commutes. This has proven to be life-changing for wheelchair users with physical disabilities, children with autism, and individuals managing mental health challenges. Through the protective and expressive medium of avatars, they can confidently interact with and contribute to society.

• Remote Security: Avatars are deployed to screen and converse with suspicious individuals from a safe distance, meaning physical human security guards only need to intervene during actual emergencies.

• Complex Retail Operations: Local convenience stores near the summit venue are actively utilizing AVITA's avatar systems. Because Japanese convenience stores offer highly complex services, full automation is highly challenging; human operators behind digital avatars, however, can easily manage complex customer transactions remotely.

Physical AI and the "Global Avatar-Based Workforce Network"

To map the future of this labor revolution, Professor Ishiguro classifies "Physical AI" into four distinct typologies.

While Type 1 (fully autonomous robots in highly controlled, enclosed environments like factories) is receiving massive capital investment from US tech firms, Ishiguro argues that human-facing service sectors cannot be easily automated by autonomous AI. Social roles were designed by humans, for humans. Thus, customer-facing services are far more suited for human-operated avatars that preserve genuine human connection.

To structure this emerging labor market, Professor Ishiguro outlines three escalating tiers of task complexity:

The Three Tiers of Avatar Labor

• Level 1: Simple Tasks (Eldercare & Hazard Work): Simple remote operations serve as the commercial entry point to build and scale the avatar market. Over time, these basic roles will gradually transition to automated AI control.

• Level 2: Expert Tasks (Remote Healthcare): This tier extends highly specialized human expertise. For instance, a doctor can operate a humanoid avatar to physically visit a patient's home remotely, delivering highly nuanced diagnostic care.

• Level 3: Cleanroom Emergency Diagnostics: When critical machinery breaks down in overseas semiconductor or pharmaceutical cleanrooms, flying a specialist across the world is painfully slow and expensive. Local avatars allow the expert to instantly log in from their home country, inspect the issue, and execute precise repairs. While these tasks will eventually be automated, their extreme complexity guarantees that human-controlled avatars will remain dominant for a very long time.

The Global Avatar-Based Workforce Network

The ultimate convergence of these technologies is a borderless, global avatar-based workforce network. By leveraging worldwide time-zone differences, an operator in Europe or South America can utilize their local daytime hours to log into a physical avatar in Japan and cover demanding local night shifts.

This enables people to work across borders without being constrained by the geographical limits of a single nation's labor market, unlocking unprecedented global diversity, workplace inclusion, and flexible employment. Additionally, because all interactions are routed through digital systems, employers can monitor and care for the physical health and performance metrics of remote operators with extreme precision.

The Mirror of Self: A Closing Dialogue

To close his historic keynote, Professor Hiroshi Ishiguro turned to his physical android double on stage for a final, poignant exchange:

• Professor Ishiguro: "Can you tell us about the future of humans and robots?"

• Android Double: "Well, looking at a robot is actually like looking at ourselves. Robots serve as a mirror showing what we value, how we communicate, and how we project our emotions. As technology evolves, the boundary between human and machine will become more blurred, but in that very blurriness, the essence of being human will appear more clearly."

With those words, Professor Ishiguro invited the audience to visit the adjacent AVITA exhibition booth and step directly into the future of human-robot symbiosis.